-- Logs begin at Wed 2022-08-17 22:25:39 UTC, end at Thu 2022-08-18 00:03:06 UTC. -- Aug 17 23:35:05.956909 dv-cinder-820027-20-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 17 23:35:05.964416 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 17 23:35:05.966378 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 23:35:05 2022] *** Aug 17 23:35:05.966378 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 23:35:05.966378 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 23:35:05.966378 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: nodename: dv-cinder-820027-20-iscsi Aug 17 23:35:05.966378 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: machine: x86_64 Aug 17 23:35:05.966378 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: clock source: unix Aug 17 23:35:05.966378 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: pcre jit disabled Aug 17 23:35:05.966378 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: detected number of CPU cores: 4 Aug 17 23:35:05.966378 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: current working directory: / Aug 17 23:35:05.966979 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: detected binary path: /usr/bin/uwsgi-core Aug 17 23:35:05.966979 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: your processes number limit is 47680 Aug 17 23:35:05.966979 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: your memory page size is 4096 bytes Aug 17 23:35:05.966979 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: detected max file descriptor number: 2048 Aug 17 23:35:05.966979 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: lock engine: pthread robust mutexes Aug 17 23:35:05.966979 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: thunder lock: enabled Aug 17 23:35:05.966979 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 17 23:35:05.966979 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 23:35:06.006591 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: Python main interpreter initialized at 0x56265a44a9c0 Aug 17 23:35:06.006591 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: python threads support enabled Aug 17 23:35:06.006591 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: your server socket listen backlog is limited to 100 connections Aug 17 23:35:06.006591 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: your mercy for graceful operations on workers is 90 seconds Aug 17 23:35:06.006969 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 23:35:06.007054 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: *** Operational MODE: preforking *** Aug 17 23:35:06.007286 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: *** uWSGI is running in multiple interpreter mode *** Aug 17 23:35:06.007286 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: spawned uWSGI master process (pid: 116278) Aug 17 23:35:06.007490 dv-cinder-820027-20-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 17 23:35:06.008552 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: spawned uWSGI worker 1 (pid: 116279, cores: 1) Aug 17 23:35:06.008552 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: spawned uWSGI worker 2 (pid: 116280, cores: 1) Aug 17 23:35:06.008552 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 23:35:06.656165 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 23:35:06.660740 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 23:35:07.720595 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 23:35:07.720595 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: from cryptography.utils import int_from_bytes Aug 17 23:35:07.721707 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 23:35:07.721707 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: from cryptography.utils import int_from_bytes Aug 17 23:35:07.723494 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 23:35:07.723494 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: from cryptography.utils import int_from_bytes Aug 17 23:35:07.723989 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 23:35:07.723989 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: from cryptography.utils import int_from_bytes Aug 17 23:35:10.166107 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 23:35:10.166705 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 23:35:10.166858 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 23:35:10.166962 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 23:35:10.167309 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 23:35:10.167391 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 23:35:10.167477 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 23:35:10.167702 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 23:35:10.167872 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.168084 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 23:35:10.168175 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.168343 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 23:35:10.168448 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.168724 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.168836 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.169043 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.169130 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.169352 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.169437 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.169663 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.169756 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.169973 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.170067 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.170277 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.170390 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.170541 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.170678 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.170851 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.170963 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.171171 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-20-iscsi {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.171280 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.171436 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.171532 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.171742 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.171834 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.172086 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.172190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-20-iscsi {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.172400 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.172486 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.172697 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.172788 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.173003 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.173089 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.173299 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.173384 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.173602 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.173790 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.173902 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.174233 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.174339 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.174543 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.174739 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.174858 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.175074 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.175175 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.175342 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.175458 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.175645 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.175764 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.175990 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.176111 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.176304 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.176416 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.176609 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.176736 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.176924 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.177041 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.177228 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.177430 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-20-iscsi {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.177547 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.177742 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.177836 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.178052 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.178227 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-20-iscsi {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.178360 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.178555 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.178767 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.178883 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.179070 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.179171 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.179373 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.179512 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.179694 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.179820 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.180045 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.180156 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.180351 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.180451 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.180674 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.180764 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.180992 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.181092 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.181303 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.181401 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.181619 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.181712 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.181917 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.182002 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.182221 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.182307 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.182524 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.182616 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.182838 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.182922 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.183136 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.183221 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.183433 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.183526 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.183679 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.183778 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.184005 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.184111 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.184270 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.184354 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.184573 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.184670 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.184894 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.184980 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.185159 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.185243 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.185405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.185503 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.185718 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.185811 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.185974 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.186066 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.186286 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.186373 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.186600 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.186686 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.186901 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.187005 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.187202 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.187293 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.187502 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.187593 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.187800 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.187897 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.188121 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.188209 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.188423 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.188507 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.188723 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.188849 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.189027 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.189125 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.189338 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.189422 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.189643 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.189737 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.190485 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.190570 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.190797 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.190881 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.191113 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.191219 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.191416 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.191510 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.191731 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.191815 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.192055 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.192147 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.192366 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.192459 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.192679 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.192764 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.192978 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.193064 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.193285 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.193377 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.193587 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.193672 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.193886 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.193973 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.194185 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.194272 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.194560 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.194692 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.194807 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.194910 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.195019 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.195123 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.195311 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.195446 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.195612 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.195700 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.195914 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.196035 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.196241 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.196336 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.196540 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.196625 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.196841 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.196933 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.197137 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.197235 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.197436 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.197522 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.197731 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.197816 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.198030 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.198123 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.198330 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.198415 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.198628 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.198714 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.198926 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.199022 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.199225 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.199312 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.199522 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.199607 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.199819 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.199909 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.200166 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.200265 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.200485 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.200570 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.200789 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.200911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.201103 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.201243 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.201390 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.201522 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.201691 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.201777 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.201993 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.202092 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.202293 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.202377 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.202593 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.202722 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.202907 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.203030 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.203207 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.203335 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.203507 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.203655 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.203817 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.203978 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.204143 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.204279 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.204447 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.204593 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.204761 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.204895 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.205057 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.205203 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.205358 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.206068 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.206204 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.206370 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.206507 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.206675 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.206809 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.206988 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.207109 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.207292 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.207408 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.207610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.207742 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.207892 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.208002 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.208260 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.208339 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.208623 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.208810 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.208945 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.209044 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.209242 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.209347 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.209520 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.209720 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.209836 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.209924 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.210147 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.210232 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.210449 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.210545 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.210766 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.210858 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.211067 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.211164 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.211371 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.211510 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.211687 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:35:10.211851 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.212032 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.212182 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.212358 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.212490 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.212682 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.212817 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.212981 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.213126 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.213294 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.213436 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.213605 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.213752 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.213926 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.214060 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.214231 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.214366 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.214539 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.214674 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.214847 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.215012 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.215142 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.215282 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.215455 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.215585 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.215764 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.215899 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.216101 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.216242 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.216401 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.216533 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.216719 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.216851 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.217026 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.217168 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.217337 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.217423 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.217653 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.217749 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.217964 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.218126 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.218270 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.218355 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.218594 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.218680 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.218910 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.218998 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.219219 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.219324 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.219539 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.219636 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.219852 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.219939 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.220189 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.220290 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.220498 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.220595 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.220804 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.220891 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.221146 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.221246 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.221479 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.221728 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.221814 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.222089 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.222227 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.222400 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.222648 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.222735 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.223006 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.223091 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.223314 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.223423 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.223622 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.223711 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.223952 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.224081 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.224287 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.224395 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.224599 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.224686 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.224908 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.224994 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.225222 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.225311 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.225528 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.225621 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.225834 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.225920 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.226153 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.226370 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.226456 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.226676 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.226769 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.226977 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.227071 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.227275 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.227367 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.227584 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.227670 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.227885 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.228029 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.228225 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.228324 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.228526 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.228612 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.228833 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.228930 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.229135 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.229220 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.229446 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.229557 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.229756 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.229855 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.230055 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.230140 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.230369 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.230500 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.230671 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.230781 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.230980 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.231086 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.231287 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.231453 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.231579 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.231662 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.231877 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.231996 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.232210 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.232319 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.232510 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.232602 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.232810 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.232896 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.233119 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.233213 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.233445 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.233538 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.233720 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.233815 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.234024 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.234118 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.234329 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.234422 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.234630 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.234716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.234934 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.235021 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.235243 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.235328 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.235548 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.235638 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.235853 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.235947 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.236191 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.236289 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.236510 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.236597 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.236842 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.236929 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.237153 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.237246 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.237471 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.237590 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.237785 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.237872 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.238084 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.238168 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.238387 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.238480 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.238687 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.238772 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.238984 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.239075 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.239281 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.239375 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.239584 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.239669 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.239883 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.240021 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.240201 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.240301 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.240499 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.240584 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.240798 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.240885 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.241093 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.241192 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.241393 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.241479 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.241692 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.241785 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.241987 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.242074 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.242283 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.242367 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.242578 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.242662 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.242889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.242975 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.243187 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.243272 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.243496 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.243584 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.243783 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.243871 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.244141 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.244231 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.244444 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.244530 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.244766 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.244852 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.245077 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.245164 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.245385 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.245488 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.245790 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.246001 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.246087 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.246309 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.246409 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.246614 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.246700 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.246922 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.247007 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.247226 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.247320 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.247531 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.247616 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.247848 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.247932 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.248183 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.248282 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.248497 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.248590 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.248802 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.248890 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.249117 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.249268 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.249413 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.249546 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.249721 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.249853 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.250023 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.250114 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.250323 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.250411 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.250658 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.250751 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.250970 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.251056 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.251276 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.251361 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.251586 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.251743 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.251891 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.252063 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.252194 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.252818 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.253011 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.253144 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.253318 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.253453 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.253624 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.253794 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.253929 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.254026 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.254233 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.254377 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.254523 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.254655 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.254837 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.254991 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.255127 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.255268 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.255429 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.255561 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.255744 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.255887 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.256080 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.256230 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.256368 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.256513 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.256677 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.256817 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.256991 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.257132 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.257299 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.257432 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.257606 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.257749 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.257913 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.258044 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.258211 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.258341 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.258494 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.258631 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.258807 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.258945 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.259112 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.259246 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.259415 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.259547 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.259717 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.259859 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.260060 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.260191 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.260346 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.260489 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.260626 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.260760 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.260929 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.261065 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.261231 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.261368 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.261540 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.261674 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.261860 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.261958 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.262167 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.262260 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.262486 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.262580 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.262790 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.262885 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.263090 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.263175 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.263391 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.263478 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.263707 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.263800 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.264033 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.264133 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.264335 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.264421 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.264633 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.264727 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.264930 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.265015 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.265247 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.265332 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.265549 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.265637 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.265847 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.265931 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.266143 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.266228 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.266462 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.266549 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.266768 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.266861 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.267064 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.267149 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.267367 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.267454 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.267675 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.267757 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.268074 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.268650 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.268877 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.268968 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.269182 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.269278 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.269490 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.269610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.269795 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.269888 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.270102 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.270231 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.270408 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.270503 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.270730 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.270815 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.271032 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.271117 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.271336 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.271429 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.271639 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.271766 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.271940 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.272094 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.272269 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.272369 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.272573 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.272661 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.272883 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.273136 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.273299 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.273467 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.273555 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.273779 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.273865 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.274089 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.274334 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.274422 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.274664 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.274749 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.274976 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.275062 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.275290 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.275378 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.275608 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.275701 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.275922 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.276052 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.276250 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.276348 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.276554 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.276640 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.276856 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.276950 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.277163 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.277260 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.277463 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.277551 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.278015 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.278107 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.278318 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.278413 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.278616 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.278704 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.278915 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.279000 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.279214 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.279299 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.279512 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.279599 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.279810 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.279896 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.280130 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.280230 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.280428 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.280521 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.280724 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.280810 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.281023 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.281116 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.281326 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.281412 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.281631 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.281715 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.281929 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.282027 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.282225 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.282322 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.282522 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.282611 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.282858 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.282956 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.283156 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.283242 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.283451 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.283538 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.283784 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.283872 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.284152 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.284255 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.284454 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.284548 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.284751 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.284837 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.285069 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.285155 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.285368 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.285453 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.285667 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.285754 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.285962 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.286050 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.286266 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.286360 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.286569 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.286657 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.286866 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.286959 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.287167 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.287261 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.287469 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.287555 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.287771 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.287856 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.288095 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.288195 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.288396 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.288481 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.288697 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.288783 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.288993 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.289089 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.289297 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.289382 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.289595 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.289683 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.289889 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.289987 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.290185 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.290276 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.290493 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.290649 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.290798 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.290943 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.291078 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.291212 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.291357 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.291493 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.291636 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.291772 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.291943 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.292125 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.292272 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.292413 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.292583 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.292716 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.292848 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.292984 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.293119 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.293252 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.293394 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.293529 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.293694 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.293839 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.293983 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.294133 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.294276 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.294419 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.294554 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.294688 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.294849 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.294990 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.295160 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.295300 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.295458 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.295600 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.295745 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.295889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.296057 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.296198 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.296372 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.296514 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.296671 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.296882 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.297022 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.297157 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.297290 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.297432 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.297586 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.297720 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.297852 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.297994 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.298138 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.298287 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.298431 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.298567 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.298708 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.298850 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.298987 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.299122 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.299270 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.299407 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.299547 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.299679 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.299839 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.300028 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.300184 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.300274 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.300484 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.300569 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.300782 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.300876 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.301080 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.301166 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.301377 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.301461 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.301687 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.301780 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.301988 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.302080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.302289 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.302376 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.302587 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.302687 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.302922 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.303007 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.303219 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.303319 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.303532 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.303629 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.303839 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.303935 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.304176 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.304279 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.304481 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.304569 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.304795 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.304881 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.305105 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.305191 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.305420 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.305515 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.305725 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.305811 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.306025 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.306117 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.306333 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.306428 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.306640 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.306725 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.306939 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.307024 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.307241 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.307335 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.307560 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.307645 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.307868 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.307952 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.308196 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.308282 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.308503 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.308590 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.308811 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.308911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.309118 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.309204 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.309419 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.309506 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.309722 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.309880 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.310028 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.310127 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.310335 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.310421 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.310643 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.310739 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.310949 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.311042 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.311255 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.311339 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.311556 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.311650 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.311863 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.311948 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.312195 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.312282 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.312494 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.312581 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.312795 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.312881 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.313103 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.313196 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.313402 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.313496 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.313700 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.313785 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.313996 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.314080 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.314302 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.314389 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.314598 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.314684 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.315414 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.315617 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.315712 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.315933 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.316050 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.316271 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.316368 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.316577 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.316731 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.316886 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.317039 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.317194 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.317350 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.317506 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.317652 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.317836 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.317983 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.318134 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.318281 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.318513 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.318650 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.318822 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.318953 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.319130 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.319264 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.319433 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.319562 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.319734 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.319865 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.320057 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.320205 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.320354 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.320490 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.320673 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.320816 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.320980 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.321124 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.321282 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.321422 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.321582 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.321719 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.321898 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.322038 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.322199 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.322341 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.322500 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.322639 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.322818 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.322958 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.323119 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.323252 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.323439 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.323571 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.323852 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.324030 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.324206 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.324383 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.324514 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.324649 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.324820 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.324956 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.325138 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.325273 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.325458 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.325588 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.325801 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.325936 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.326071 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.326205 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.326370 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.326515 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.326651 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.326787 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.326957 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.327100 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.327264 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.327400 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.327575 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.327711 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.327876 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.328035 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.328221 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.328371 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.328542 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.328684 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.328842 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.328974 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.329157 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.329287 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.329475 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.329618 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.329784 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.329917 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.330104 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.330244 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.330997 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.331150 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.331331 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.331419 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.331635 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.331723 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.331939 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.332120 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.332271 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.332361 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.332570 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.332704 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.332869 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.332964 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.333172 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.333266 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.333474 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.333567 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.333775 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.333864 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.334078 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.334171 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.334383 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.334470 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.334683 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.334773 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.334984 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.335072 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.335286 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.335372 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.335586 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.335681 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.335887 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.335994 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.336224 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.336388 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.336522 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.336607 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.336842 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.336930 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.337140 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.337235 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.337455 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.337541 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.337758 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.337844 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.338057 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.338160 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.338355 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.338442 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.338655 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.338742 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.338954 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.339049 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.339253 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.339340 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.339553 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.339639 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.339891 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.340011 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.340219 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.340307 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.340533 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.340625 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.340856 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.340955 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.341179 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.341265 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.341482 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.341568 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.341793 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.341886 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.342113 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.342200 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.342415 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.342510 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.342716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.342803 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.343023 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.343110 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.343322 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.343418 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.343621 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.343707 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.343920 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.344036 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.344250 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.344347 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.344551 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.344637 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.344847 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.344934 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.345145 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.345244 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.345442 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.345535 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.345741 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.345835 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.346065 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.346157 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.346381 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.346467 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.346680 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.346765 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.346976 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.347063 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.347274 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.347361 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.347572 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.347657 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.347871 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.347994 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.348194 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.348284 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.348525 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.348610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.348822 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.348909 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.349139 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.349224 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.349443 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.349538 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.349751 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.349837 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.350060 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.350146 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.350368 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.350467 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.350675 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.350761 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.350984 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.351070 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.351293 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.351387 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.351602 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.351694 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.351910 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.352014 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.352240 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.352338 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.352553 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.352759 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.352882 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.353086 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.353181 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.353399 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.353660 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.353747 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.353986 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.354073 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.354298 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.354386 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.354606 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.354700 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.354912 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.354998 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.355217 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.355304 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.355523 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.355608 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.355828 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.355913 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.356161 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.356250 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.356469 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.356556 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.356777 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.356875 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.357102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.357189 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.357411 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.357497 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.357721 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.357817 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.358030 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.358125 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.358338 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.358428 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.358645 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.358732 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.358954 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.359041 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.359263 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.359349 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.359573 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.359667 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.359887 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.359993 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.360220 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.360318 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.360528 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.360622 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.360834 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.360922 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.361144 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.361243 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.361451 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.361589 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.362278 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.362410 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.362567 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.362713 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.362881 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.363012 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.363186 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.363273 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.363494 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.363582 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.363803 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.363891 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.364134 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.364229 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.364450 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.364538 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.364761 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.364848 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.365072 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.365159 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.365378 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.365590 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.365678 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.365906 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.365994 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.366239 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.366487 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.366584 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.366798 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.366889 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.367125 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.367220 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.367448 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.367535 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.367767 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.367854 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.368093 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.368196 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.368401 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.368539 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.368710 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.368844 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.369010 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.369150 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.369308 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.369440 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.369612 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.369749 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.369918 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.370052 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.370217 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.370349 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.370530 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.370671 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.370816 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.370951 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.371118 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.371346 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.371436 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.371694 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.371846 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.372026 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.372269 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.372403 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.372614 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.372711 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.372926 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.373060 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.373245 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.373376 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.373565 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.373706 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.373866 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.373998 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.374167 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.374304 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.374479 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.374629 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.374774 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.374914 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.375056 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.375198 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.375358 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.375503 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.375664 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.375796 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.375980 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.376116 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.376296 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.376443 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.376606 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.376749 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.376907 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.377042 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.377185 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.377853 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.378042 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.378176 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.378340 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.378490 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.378633 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.378776 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.378935 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.379078 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.379215 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.379348 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.379521 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.379658 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.379817 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.379983 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.380140 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.380270 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.380443 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.380582 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.380739 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.380881 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.381040 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.381184 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.381319 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.381454 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.381619 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.381742 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.381921 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.382024 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.382218 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.382306 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.382515 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.382611 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.382817 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.382975 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.383122 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.383252 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.383408 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.383494 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.383726 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.383829 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.384051 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.384143 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.384369 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.384455 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.384675 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.384770 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.384981 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.385075 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.385296 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.385426 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.385794 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.385976 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.386164 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.386342 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.386508 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.386674 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.386823 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.386988 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.387317 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.387403 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.387645 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.387741 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.387950 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.388099 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.388276 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.388364 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.388580 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.388680 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.388901 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.388989 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.389213 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.389342 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.389517 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.389655 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.389839 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.389965 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.390149 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.390274 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.390457 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.390582 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.390766 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.390889 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.391073 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.391196 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.391381 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.391507 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.391688 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.391814 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.392019 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.392147 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.392330 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.392458 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.392637 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.392762 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.392963 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.393092 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.393274 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.393400 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.393579 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.393711 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.393886 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.394049 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.394193 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.394364 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.394503 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.394679 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.394838 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.395000 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.395153 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.395291 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.395467 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.395597 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.395779 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.395904 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.396117 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.396264 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.396426 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.396535 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.396733 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.396850 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.397039 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.397175 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.397345 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.397487 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.397661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.397789 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.397988 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.398203 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.398305 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.398512 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.398611 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.398828 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.398986 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.399144 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.399295 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.399452 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.399611 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.399771 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.399928 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.400115 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.400248 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.400423 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.400564 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.400741 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.400881 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.401047 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.401188 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.401373 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.401506 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.401712 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.401834 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.402037 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.402124 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.402359 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.402447 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.402662 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.403015 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.403220 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.403316 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.403523 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.403613 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.403830 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.403916 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.404179 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.404285 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.404487 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.404583 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.404787 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.404874 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.405088 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.405184 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.405386 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.405480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.405685 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.405770 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.405984 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.406084 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.406283 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.406370 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.406582 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.406667 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.406882 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.406969 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.407180 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.407266 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.407483 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.407574 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.407781 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.407868 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.408102 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.408203 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.408403 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.408510 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.408726 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.408850 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.409025 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.409118 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.409321 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.409414 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.409621 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.409709 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.409921 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.410069 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.410207 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.410348 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.410494 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.410630 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.410789 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.410925 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.411072 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.411217 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.411402 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.411547 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.411730 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.411866 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.412060 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.412205 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.412380 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.412513 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.412685 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.412826 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.413002 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.413147 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.413308 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.413441 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.413617 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.413705 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.413924 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.414019 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.414230 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.414323 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.414537 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.414624 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.414844 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.414932 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.415153 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.415247 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.415457 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.415543 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.415760 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.415847 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.416091 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.416252 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.416398 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.416505 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.416704 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.416794 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.417010 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.417101 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.417331 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.417438 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.417633 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.417721 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.417949 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.418035 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.418262 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.418360 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.418569 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.418656 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.418884 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.419028 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.419191 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.419325 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.419497 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.419635 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.419805 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.419937 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.420134 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.420225 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.420443 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.420579 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.420746 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.420879 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.421051 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.421186 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.421358 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.421490 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.421662 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.421806 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.421970 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.422104 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.422282 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.422414 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.422595 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.422747 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.422885 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.423026 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.423207 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.423352 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.423520 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.423743 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.423880 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.424062 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.424725 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.424861 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.425036 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.425190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.425362 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.425498 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.425674 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.425804 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.425984 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.426121 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.426288 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.426420 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.426561 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116279) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 23:35:10.426697 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.426995 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:35:10.427236 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 23:35:10.580423 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO dbcounter [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] Registered counter for database nova_api Aug 17 23:35:10.582814 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO dbcounter [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] Registered counter for database nova_api Aug 17 23:35:10.604126 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_db.sqlalchemy.engines [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116279) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 23:35:10.604360 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG oslo_db.sqlalchemy.engines [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 23:35:10.611127 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG dbcounter [-] [116279] Writer thread running {{(pid=116279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 23:35:10.611255 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG dbcounter [-] [116280] Writer thread running {{(pid=116280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 23:35:10.667162 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.context [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),21568e4d-f90d-40c1-be8c-94bd510fd532(cell1) {{(pid=116279) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 23:35:10.667345 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.context [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),21568e4d-f90d-40c1-be8c-94bd510fd532(cell1) {{(pid=116280) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 23:35:10.671080 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG oslo_concurrency.lockutils [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=116280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:35:10.671362 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:35:10.671834 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:35:10.672051 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG oslo_concurrency.lockutils [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:35:10.673450 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:35:10.673935 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG oslo_concurrency.lockutils [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:35:10.674690 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:35:10.675134 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:35:10.675635 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG oslo_concurrency.lockutils [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=116280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:35:10.676253 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG oslo_concurrency.lockutils [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:35:10.677124 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:35:10.678547 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG oslo_concurrency.lockutils [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:35:10.679109 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO dbcounter [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] Registered counter for database nova_cell0 Aug 17 23:35:10.680867 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO dbcounter [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] Registered counter for database nova_cell0 Aug 17 23:35:10.684842 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO dbcounter [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] Registered counter for database nova_cell1 Aug 17 23:35:10.686519 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO dbcounter [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] Registered counter for database nova_cell1 Aug 17 23:35:10.693339 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_db.sqlalchemy.engines [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116279) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 23:35:10.696182 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_db.sqlalchemy.engines [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116279) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 23:35:10.697459 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG oslo_db.sqlalchemy.engines [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 23:35:10.698941 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG dbcounter [-] [116279] Writer thread running {{(pid=116279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 23:35:10.700792 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG oslo_db.sqlalchemy.engines [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 23:35:10.704210 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG dbcounter [-] [116280] Writer thread running {{(pid=116280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 23:35:10.846497 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG dbcounter [-] [116280] Writer thread running {{(pid=116280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 23:35:10.854992 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO dbcounter [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] Registered counter for database nova_cell0 Aug 17 23:35:10.856673 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG dbcounter [-] [116279] Writer thread running {{(pid=116279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 23:35:10.862543 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG oslo_db.sqlalchemy.engines [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 23:35:10.865942 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO dbcounter [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] Registered counter for database nova_cell0 Aug 17 23:35:10.866787 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG dbcounter [-] [116280] Writer thread running {{(pid=116280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 23:35:10.874751 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_db.sqlalchemy.engines [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116279) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 23:35:10.883103 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG dbcounter [-] [116279] Writer thread running {{(pid=116279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 23:35:11.201685 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: WARNING keystonemiddleware.auth_token [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 23:35:11.202676 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: WARNING keystonemiddleware.auth_token [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 23:35:11.208881 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: WARNING keystonemiddleware.auth_token [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 23:35:11.209856 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: WARNING keystonemiddleware.auth_token [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 23:35:11.546830 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: WARNING keystonemiddleware.auth_token [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 23:35:11.549140 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: WARNING keystonemiddleware.auth_token [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 23:35:11.553077 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: WARNING keystonemiddleware.auth_token [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 23:35:11.555270 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: WARNING keystonemiddleware.auth_token [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 23:35:11.558291 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56265a44a9c0 pid: 116280 (default app) Aug 17 23:35:11.560353 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:35:11.560512 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56265a44a9c0 pid: 116279 (default app) Aug 17 23:35:11.561522 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-676d0013-7ac5-4da1-ab0d-a32d626d6995 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001734 Aug 17 23:35:11.561923 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Wed Aug 17 23:35:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:36:28.720912 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:36:28.722145 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 Aug 17 23:36:28.724385 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 17 23:36:28 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:36:28.734115 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG dbcounter [-] [116280] Writing DB stats nova_api:SELECT=3 {{(pid=116280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:28.735054 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG dbcounter [-] [116280] Writing DB stats nova_cell0:SELECT=3 {{(pid=116280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:28.736156 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG dbcounter [-] [116280] Writing DB stats nova_cell1:SELECT=3 {{(pid=116280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:28.737088 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG dbcounter [-] [116280] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=116280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:29.587464 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-568dff4e-223e-428c-958c-7d2cb3a94a76 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:36:29.618251 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-568dff4e-223e-428c-958c-7d2cb3a94a76 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.889511 Aug 17 23:36:29.619140 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 2/3] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Aug 17 23:36:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:36:31.937825 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:36:31.938473 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-7577a7a5-e06b-40a1-8f64-5023931505d6 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 17 23:36:31.943565 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 2/4] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 17 23:36:31 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:36:32.379284 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-ac49748a-3778-47b0-bc85-3944812ace55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0, "disk": 1, "name": "cirros256", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 256, "rxtx_factor": 1.0}} {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:36:32.398974 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:36:32.398974 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: warnings.warn(msg) Aug 17 23:36:32.428636 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-ac49748a-3778-47b0-bc85-3944812ace55 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.484164 Aug 17 23:36:32.429301 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 3/5] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Aug 17 23:36:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 23:36:32.653680 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-7673ff92-7829-407f-b107-177b87f11350 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:36:32.658604 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:36:32.658604 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: warnings.warn(msg) Aug 17 23:36:32.661446 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG dbcounter [-] [116279] Writing DB stats nova_api:SELECT=3 {{(pid=116279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:32.662202 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG dbcounter [-] [116279] Writing DB stats nova_cell0:SELECT=3 {{(pid=116279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:32.663142 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG dbcounter [-] [116279] Writing DB stats nova_cell1:SELECT=3 {{(pid=116279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:32.663800 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG dbcounter [-] [116279] Writing DB stats nova_cell0:SELECT=3 {{(pid=116279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:32.727403 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-7673ff92-7829-407f-b107-177b87f11350 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289647 Aug 17 23:36:32.728080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 3/6] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Aug 17 23:36:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:36:35.066561 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-ac49748a-3778-47b0-bc85-3944812ace55 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:36:35.067473 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-ac49748a-3778-47b0-bc85-3944812ace55 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 17 23:36:35.067866 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 4/7] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 17 23:36:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:36:35.710156 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-8f85dcfe-11ef-4197-b0f5-76d0c890d0de admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 5, "swap": 0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:36:35.731326 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:36:35.731326 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: warnings.warn(msg) Aug 17 23:36:35.755849 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-8f85dcfe-11ef-4197-b0f5-76d0c890d0de admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.681719 Aug 17 23:36:35.756513 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 4/8] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Aug 17 23:36:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 23:36:35.769847 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-3a55afa5-d933-4dee-8eea-e62b8a6c3045 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:36:35.773149 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:36:35.773149 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: warnings.warn(msg) Aug 17 23:36:35.808696 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-3a55afa5-d933-4dee-8eea-e62b8a6c3045 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043478 Aug 17 23:36:35.809436 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 5/9] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Aug 17 23:36:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:36:38.178084 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-8f85dcfe-11ef-4197-b0f5-76d0c890d0de admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:36:38.179088 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-8f85dcfe-11ef-4197-b0f5-76d0c890d0de admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 17 23:36:38.179493 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 17 23:36:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:36:38.523034 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-a68750b1-8bbb-4d43-96a6-84e03b98fca6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024, "vcpus": 1, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:36:38.542514 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-a68750b1-8bbb-4d43-96a6-84e03b98fca6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.357083 Aug 17 23:36:38.543144 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 6/11] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Aug 17 23:36:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 23:36:38.555525 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-3abb19f5-8541-49cd-afd9-4012ccd22e54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:36:38.578578 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-3abb19f5-8541-49cd-afd9-4012ccd22e54 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026651 Aug 17 23:36:38.579293 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 6/12] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Aug 17 23:36:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:36:40.872918 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-a68750b1-8bbb-4d43-96a6-84e03b98fca6 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:36:40.873831 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-a68750b1-8bbb-4d43-96a6-84e03b98fca6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 17 23:36:40.874241 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 7/13] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 17 23:36:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:36:41.298583 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-12361961-0729-449a-9a96-99e0f12478bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "vcpus": 2}} {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:36:41.325205 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-12361961-0729-449a-9a96-99e0f12478bb admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.444914 Aug 17 23:36:41.332071 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 7/14] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Aug 17 23:36:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 23:36:41.340473 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-09e3a3e2-313d-457a-93f1-86c6c647f2e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:36:41.367232 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-09e3a3e2-313d-457a-93f1-86c6c647f2e9 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030381 Aug 17 23:36:41.369378 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 8/15] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Aug 17 23:36:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:36:43.705799 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-12361961-0729-449a-9a96-99e0f12478bb admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:36:43.706805 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-12361961-0729-449a-9a96-99e0f12478bb admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 17 23:36:43.707204 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 8/16] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 17 23:36:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:36:44.132294 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-1ddf9afa-0bf0-469d-917b-5a763b3772d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4", "vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:36:44.153950 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-1ddf9afa-0bf0-469d-917b-5a763b3772d2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.440434 Aug 17 23:36:44.157192 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 9/17] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Aug 17 23:36:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 23:36:44.166896 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-be867d24-3058-4b05-9b94-819dd216843b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:36:44.192837 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-be867d24-3058-4b05-9b94-819dd216843b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029561 Aug 17 23:36:44.193437 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 9/18] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Aug 17 23:36:44 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:36:46.860537 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-1ddf9afa-0bf0-469d-917b-5a763b3772d2 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:36:46.861540 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-1ddf9afa-0bf0-469d-917b-5a763b3772d2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 17 23:36:46.861933 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 10/19] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 17 23:36:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:36:47.256110 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-f3a36585-f6b6-45ca-85a7-f3a92274d145 admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:36:47.280241 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-f3a36585-f6b6-45ca-85a7-f3a92274d145 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.412112 Aug 17 23:36:47.281363 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 10/20] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Aug 17 23:36:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:36:49.600475 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-1ddf9afa-0bf0-469d-917b-5a763b3772d2 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:36:49.601477 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-1ddf9afa-0bf0-469d-917b-5a763b3772d2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 17 23:36:49.601863 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 11/21] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 17 23:36:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:36:50.000394 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-fd5df2ec-89a3-43d5-9145-46d85be7ba47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "ram": 512, "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "rxtx_factor": 1.0}} {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:36:50.020092 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-fd5df2ec-89a3-43d5-9145-46d85be7ba47 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.412133 Aug 17 23:36:50.020774 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 11/22] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Aug 17 23:36:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 23:36:50.034267 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-8e24e24c-c4c4-4e68-a80e-f32d8b632636 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:36:50.063311 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-8e24e24c-c4c4-4e68-a80e-f32d8b632636 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033526 Aug 17 23:36:50.068568 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 12/23] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Aug 17 23:36:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:36:52.383539 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-fd5df2ec-89a3-43d5-9145-46d85be7ba47 admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:36:52.384616 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-fd5df2ec-89a3-43d5-9145-46d85be7ba47 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 17 23:36:52.385011 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 12/24] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 17 23:36:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:36:52.798059 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-6d1f0b1f-9d1a-45ca-a509-02837a40c4f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "id": "2"}} {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:36:52.818034 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-6d1f0b1f-9d1a-45ca-a509-02837a40c4f7 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.426675 Aug 17 23:36:52.818580 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 13/25] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Aug 17 23:36:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 23:36:52.830474 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-d76f6322-697a-4670-b99e-ca70a3c43291 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:36:52.855373 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-d76f6322-697a-4670-b99e-ca70a3c43291 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028516 Aug 17 23:36:52.855947 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 13/26] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Aug 17 23:36:52 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:36:55.183427 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-6d1f0b1f-9d1a-45ca-a509-02837a40c4f7 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:36:55.184627 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-6d1f0b1f-9d1a-45ca-a509-02837a40c4f7 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001636 Aug 17 23:36:55.185090 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 14/27] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 17 23:36:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:36:55.612684 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-be26145d-1bcf-4175-a87c-30a30edc2fda admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "disk": 40}} {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:36:55.632836 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-be26145d-1bcf-4175-a87c-30a30edc2fda admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.441088 Aug 17 23:36:55.633373 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 14/28] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Aug 17 23:36:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 23:36:55.646203 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-ace070d2-8010-4f07-8fdc-ef6ce9098eab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:36:55.672245 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-ace070d2-8010-4f07-8fdc-ef6ce9098eab admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029478 Aug 17 23:36:55.673551 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 15/29] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Aug 17 23:36:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:36:58.050956 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-be26145d-1bcf-4175-a87c-30a30edc2fda admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:36:58.052111 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-be26145d-1bcf-4175-a87c-30a30edc2fda admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001660 Aug 17 23:36:58.053063 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 15/30] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 17 23:36:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:36:58.500646 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-0409c1ee-f669-4eaf-bba2-1668b24ef22c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "swap": 0}} {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:36:58.522347 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-0409c1ee-f669-4eaf-bba2-1668b24ef22c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.463150 Aug 17 23:36:58.522994 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 16/31] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Aug 17 23:36:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 23:36:58.535900 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-5ec8858e-04a6-4b85-929c-fd9b3ec6c4bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:36:58.561341 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-5ec8858e-04a6-4b85-929c-fd9b3ec6c4bb admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029140 Aug 17 23:36:58.562162 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 16/32] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Aug 17 23:36:58 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:37:00.936292 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-0409c1ee-f669-4eaf-bba2-1668b24ef22c admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:00.937245 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-0409c1ee-f669-4eaf-bba2-1668b24ef22c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 17 23:37:00.937792 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 17/33] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 17 23:37:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:37:01.362348 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-cafa5582-6bb5-4bf8-a36f-e9a8129ee83f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "ram": 16384, "swap": 0, "rxtx_factor": 1.0, "vcpus": 8, "name": "m1.xlarge", "id": "5"}} {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:37:01.383928 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-cafa5582-6bb5-4bf8-a36f-e9a8129ee83f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.440266 Aug 17 23:37:01.384491 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 17/34] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Aug 17 23:37:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 23:37:01.396525 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-ca86d859-69c1-4bd8-a24b-d8d31dc526ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:37:01.404974 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG dbcounter [-] [116280] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=116280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:37:01.425133 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-ca86d859-69c1-4bd8-a24b-d8d31dc526ca admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032245 Aug 17 23:37:01.428019 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 18/35] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Aug 17 23:37:01 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:37:20.434190 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-cafa5582-6bb5-4bf8-a36f-e9a8129ee83f admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:20.435241 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-cafa5582-6bb5-4bf8-a36f-e9a8129ee83f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 17 23:37:20.435648 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 18/36] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 17 23:37:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:37:20.823753 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-201f1dc5-a21d-434c-a02e-c3ce5666dd69 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:20.842184 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-201f1dc5-a21d-434c-a02e-c3ce5666dd69 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400443 Aug 17 23:37:20.842650 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 19/37] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Aug 17 23:37:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:37:21.886415 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-cafa5582-6bb5-4bf8-a36f-e9a8129ee83f admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:21.887446 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-cafa5582-6bb5-4bf8-a36f-e9a8129ee83f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 17 23:37:21.887839 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 19/38] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 17 23:37:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:37:22.403567 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-7b7bca38-0958-4609-96ae-69a205835245 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:22.409434 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.wsgi [None req-7b7bca38-0958-4609-96ae-69a205835245 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-7b7bca38-0958-4609-96ae-69a205835245 admin admin] Request method failure captured: Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Accept: application/json Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Accept-Encoding: gzip, deflate Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Connection: keep-alive Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Content-Length: 0 Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Host: 10.222.0.26 Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Openstack-Api-Version: compute 2.90 Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Openstack-System-Scope: None Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: User-Agent: python-novaclient Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Auth-Token: gAAAAABi_XuxSriVgNvtrhAdINtEcIg-qFOmkTrbeCeHpniDLvFpTBLeB-5vQ9U7CQvlcoo1dEUhm11xqQSCu-grrpSFm-Cxb2owxeJVsEra_7yYujgnXXzqqtPQsec_uUkEn1UGrHejGZ-ZosftzijM2E8tzfJ25D3wxme7rGLoIozwIhmNnvI Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Domain-Id: None Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Domain-Name: None Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Identity-Status: Confirmed Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Is-Admin-Project: True Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Project-Domain-Id: default Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Project-Domain-Name: Default Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Project-Id: fd475051e9cd456abbb6cff649b374cc Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Project-Name: admin Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Role: member,admin,reader Aug 17 23:37:22.412661 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Roles: member,admin,reader Aug 17 23:37:22.414340 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fd475051e9cd456abbb6cff649b374cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fd475051e9cd456abbb6cff649b374cc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd475051e9cd456abbb6cff649b374cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd475051e9cd456abbb6cff649b374cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:37:22.414340 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Tenant: admin Aug 17 23:37:22.414340 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Tenant-Id: fd475051e9cd456abbb6cff649b374cc Aug 17 23:37:22.414340 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Tenant-Name: admin Aug 17 23:37:22.414340 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-User: admin Aug 17 23:37:22.414340 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-User-Domain-Id: default Aug 17 23:37:22.414340 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-User-Domain-Name: Default Aug 17 23:37:22.414340 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-User-Id: 8f1a8fbc56c44c829c8dd8013a782220 Aug 17 23:37:22.414340 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-User-Name: admin Aug 17 23:37:22.414340 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: method: > Aug 17 23:37:22.414340 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: exception: Flavor 42 could not be found. Aug 17 23:37:22.414340 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: action_args: {'id': '42'} Aug 17 23:37:22.414340 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:37:22.414340 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:37:22.415240 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 23:37:22.415240 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 23:37:22.415240 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 23:37:22.415240 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 23:37:22.415240 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 23:37:22.415240 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 23:37:22.415240 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 23:37:22.415240 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 23:37:22.415240 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 23:37:22.415240 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:37:22.415240 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 23:37:22.415240 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 23:37:22.415240 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 17 23:37:22.415240 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Aug 17 23:37:22.415240 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:37:22.415240 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Aug 17 23:37:22.415240 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:37:22.415240 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:37:22.415240 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:37:22.416610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:37:22.416610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:37:22.416610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:37:22.416610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:37:22.416610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 23:37:22.416610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:37:22.416610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 17 23:37:22.416610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Aug 17 23:37:22.416610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:37:22.416610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Aug 17 23:37:22.416610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:37:22.416610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:37:22.416610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:37:22.416610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:37:22.416610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:37:22.416610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 17 23:37:22.416610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Aug 17 23:37:22.416610 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-7b7bca38-0958-4609-96ae-69a205835245 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=116280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:37:22.417998 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-7b7bca38-0958-4609-96ae-69a205835245 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.387635 Aug 17 23:37:22.417998 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 20/39] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Aug 17 23:37:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 23:37:22.424338 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-95107ecf-3566-40b4-adbf-7b498154290c admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:22.428382 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG dbcounter [-] [116279] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=116279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:37:22.448040 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-95107ecf-3566-40b4-adbf-7b498154290c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027735 Aug 17 23:37:22.448608 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 20/40] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Aug 17 23:37:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:37:22.458456 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-f4887afd-7c25-4541-b4f6-05a0bb6e874b admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:22.481903 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-f4887afd-7c25-4541-b4f6-05a0bb6e874b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027040 Aug 17 23:37:22.482426 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 21/41] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Aug 17 23:37:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:37:22.492309 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-ef1ebf52-3887-4c69-9a15-085bdfc207ce admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:22.498408 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.wsgi [None req-ef1ebf52-3887-4c69-9a15-085bdfc207ce admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-ef1ebf52-3887-4c69-9a15-085bdfc207ce admin admin] Request method failure captured: Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Accept: application/json Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Accept-Encoding: gzip, deflate Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Connection: keep-alive Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Content-Length: 0 Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Host: 10.222.0.26 Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Openstack-Api-Version: compute 2.90 Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Openstack-System-Scope: None Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: User-Agent: python-novaclient Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Auth-Token: gAAAAABi_XuxSriVgNvtrhAdINtEcIg-qFOmkTrbeCeHpniDLvFpTBLeB-5vQ9U7CQvlcoo1dEUhm11xqQSCu-grrpSFm-Cxb2owxeJVsEra_7yYujgnXXzqqtPQsec_uUkEn1UGrHejGZ-ZosftzijM2E8tzfJ25D3wxme7rGLoIozwIhmNnvI Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Domain-Id: None Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Domain-Name: None Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Identity-Status: Confirmed Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Is-Admin-Project: True Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Project-Domain-Id: default Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Project-Domain-Name: Default Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Project-Id: fd475051e9cd456abbb6cff649b374cc Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Project-Name: admin Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Role: member,admin,reader Aug 17 23:37:22.502253 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Roles: member,admin,reader Aug 17 23:37:22.503537 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fd475051e9cd456abbb6cff649b374cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fd475051e9cd456abbb6cff649b374cc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd475051e9cd456abbb6cff649b374cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd475051e9cd456abbb6cff649b374cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:37:22.503537 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Tenant: admin Aug 17 23:37:22.503537 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Tenant-Id: fd475051e9cd456abbb6cff649b374cc Aug 17 23:37:22.503537 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Tenant-Name: admin Aug 17 23:37:22.503537 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-User: admin Aug 17 23:37:22.503537 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-User-Domain-Id: default Aug 17 23:37:22.503537 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-User-Domain-Name: Default Aug 17 23:37:22.503537 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-User-Id: 8f1a8fbc56c44c829c8dd8013a782220 Aug 17 23:37:22.503537 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-User-Name: admin Aug 17 23:37:22.503537 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: method: > Aug 17 23:37:22.503537 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: exception: Flavor 42 could not be found. Aug 17 23:37:22.503537 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: action_args: {'id': '42'} Aug 17 23:37:22.503537 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:37:22.503537 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:37:22.504405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 23:37:22.504405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 23:37:22.504405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 23:37:22.504405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 23:37:22.504405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 23:37:22.504405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 23:37:22.504405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 23:37:22.504405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 23:37:22.504405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 23:37:22.504405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:37:22.504405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 23:37:22.504405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 23:37:22.504405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 17 23:37:22.504405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Aug 17 23:37:22.504405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:37:22.504405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Aug 17 23:37:22.504405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:37:22.504405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:37:22.504405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:37:22.505698 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:37:22.505698 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:37:22.505698 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:37:22.505698 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:37:22.505698 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 23:37:22.505698 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:37:22.505698 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 17 23:37:22.505698 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Aug 17 23:37:22.505698 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:37:22.505698 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Aug 17 23:37:22.505698 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:37:22.505698 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:37:22.505698 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:37:22.505698 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:37:22.505698 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:37:22.505698 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 17 23:37:22.505698 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Aug 17 23:37:22.505698 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-ef1ebf52-3887-4c69-9a15-085bdfc207ce admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=116279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:37:22.506892 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-ef1ebf52-3887-4c69-9a15-085bdfc207ce admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014911 Aug 17 23:37:22.506892 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 21/42] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Aug 17 23:37:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 23:37:23.454248 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-f4887afd-7c25-4541-b4f6-05a0bb6e874b admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:23.455251 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-f4887afd-7c25-4541-b4f6-05a0bb6e874b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 17 23:37:23.455644 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 22/43] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 17 23:37:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:37:23.981955 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-fb3f0a23-f4c1-4ede-81e5-f72c99ea2e87 admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:23.988243 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.wsgi [None req-fb3f0a23-f4c1-4ede-81e5-f72c99ea2e87 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-fb3f0a23-f4c1-4ede-81e5-f72c99ea2e87 admin admin] Request method failure captured: Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Accept: application/json Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Accept-Encoding: gzip, deflate Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Connection: keep-alive Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Content-Length: 0 Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Host: 10.222.0.26 Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Openstack-Api-Version: compute 2.90 Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Openstack-System-Scope: None Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: User-Agent: python-novaclient Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Auth-Token: gAAAAABi_XuzKhD7MicO6ZWXgoYIwTCLE1oxOG-J7EXBbBz2wOruLzYAqQLvVE64AqQCJkRQrI28H43AbQZR78IC2OSI1hl5-qHiFWyKOr0lKxerO4UHqSFhz9wZoMtrhjxC2hzAW88piVx3-pyE3JrE8kZppaLiEBBru8-UZaeO1Oicl67_KGI Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Domain-Id: None Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Domain-Name: None Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Identity-Status: Confirmed Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Is-Admin-Project: True Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Project-Domain-Id: default Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Project-Domain-Name: Default Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Project-Id: fd475051e9cd456abbb6cff649b374cc Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Project-Name: admin Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Role: member,admin,reader Aug 17 23:37:23.989716 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Roles: member,admin,reader Aug 17 23:37:23.991215 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fd475051e9cd456abbb6cff649b374cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fd475051e9cd456abbb6cff649b374cc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd475051e9cd456abbb6cff649b374cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd475051e9cd456abbb6cff649b374cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:37:23.991215 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Tenant: admin Aug 17 23:37:23.991215 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Tenant-Id: fd475051e9cd456abbb6cff649b374cc Aug 17 23:37:23.991215 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Tenant-Name: admin Aug 17 23:37:23.991215 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-User: admin Aug 17 23:37:23.991215 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-User-Domain-Id: default Aug 17 23:37:23.991215 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-User-Domain-Name: Default Aug 17 23:37:23.991215 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-User-Id: 8f1a8fbc56c44c829c8dd8013a782220 Aug 17 23:37:23.991215 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-User-Name: admin Aug 17 23:37:23.991215 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: method: > Aug 17 23:37:23.991215 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: exception: Flavor 84 could not be found. Aug 17 23:37:23.991215 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: action_args: {'id': '84'} Aug 17 23:37:23.991215 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:37:23.991215 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:37:23.992122 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 23:37:23.992122 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 23:37:23.992122 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 23:37:23.992122 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 23:37:23.992122 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 23:37:23.992122 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 23:37:23.992122 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 23:37:23.992122 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 23:37:23.992122 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 23:37:23.992122 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:37:23.992122 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 23:37:23.992122 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 23:37:23.992122 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 17 23:37:23.992122 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Aug 17 23:37:23.992122 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:37:23.992122 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Aug 17 23:37:23.992122 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:37:23.992122 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:37:23.992122 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:37:23.993369 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:37:23.993369 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:37:23.993369 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:37:23.993369 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:37:23.993369 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 23:37:23.993369 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:37:23.993369 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 17 23:37:23.993369 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Aug 17 23:37:23.993369 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:37:23.993369 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Aug 17 23:37:23.993369 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:37:23.993369 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:37:23.993369 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:37:23.993369 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:37:23.993369 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:37:23.993369 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 17 23:37:23.993369 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Aug 17 23:37:23.993369 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-fb3f0a23-f4c1-4ede-81e5-f72c99ea2e87 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=116279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:37:23.994620 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-fb3f0a23-f4c1-4ede-81e5-f72c99ea2e87 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.397358 Aug 17 23:37:23.994620 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 22/44] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Aug 17 23:37:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 23:37:24.001437 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-28e0a410-e5a7-4a1c-b5a1-9c23b2257c8b admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:24.016098 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-28e0a410-e5a7-4a1c-b5a1-9c23b2257c8b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018846 Aug 17 23:37:24.016622 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 23/45] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Aug 17 23:37:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:37:24.026336 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-80c4417f-b3f1-4b97-af23-8cd5460afba5 admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:24.042844 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-80c4417f-b3f1-4b97-af23-8cd5460afba5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020024 Aug 17 23:37:24.043383 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Aug 17 23:37:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:37:24.053284 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-24517fff-01f6-4fa2-a5c7-fa292dc5586c admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:24.058574 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.wsgi [None req-24517fff-01f6-4fa2-a5c7-fa292dc5586c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-24517fff-01f6-4fa2-a5c7-fa292dc5586c admin admin] Request method failure captured: Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Accept: application/json Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Accept-Encoding: gzip, deflate Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Connection: keep-alive Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Content-Length: 0 Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Host: 10.222.0.26 Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Openstack-Api-Version: compute 2.90 Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Openstack-System-Scope: None Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: User-Agent: python-novaclient Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Auth-Token: gAAAAABi_XuzKhD7MicO6ZWXgoYIwTCLE1oxOG-J7EXBbBz2wOruLzYAqQLvVE64AqQCJkRQrI28H43AbQZR78IC2OSI1hl5-qHiFWyKOr0lKxerO4UHqSFhz9wZoMtrhjxC2hzAW88piVx3-pyE3JrE8kZppaLiEBBru8-UZaeO1Oicl67_KGI Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Domain-Id: None Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Domain-Name: None Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Identity-Status: Confirmed Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Is-Admin-Project: True Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Project-Domain-Id: default Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Project-Domain-Name: Default Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Project-Id: fd475051e9cd456abbb6cff649b374cc Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Project-Name: admin Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Role: member,admin,reader Aug 17 23:37:24.060102 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Roles: member,admin,reader Aug 17 23:37:24.062136 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fd475051e9cd456abbb6cff649b374cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fd475051e9cd456abbb6cff649b374cc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd475051e9cd456abbb6cff649b374cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd475051e9cd456abbb6cff649b374cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:37:24.062136 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Tenant: admin Aug 17 23:37:24.062136 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Tenant-Id: fd475051e9cd456abbb6cff649b374cc Aug 17 23:37:24.062136 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Tenant-Name: admin Aug 17 23:37:24.062136 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-User: admin Aug 17 23:37:24.062136 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-User-Domain-Id: default Aug 17 23:37:24.062136 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-User-Domain-Name: Default Aug 17 23:37:24.062136 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-User-Id: 8f1a8fbc56c44c829c8dd8013a782220 Aug 17 23:37:24.062136 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-User-Name: admin Aug 17 23:37:24.062136 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: method: > Aug 17 23:37:24.062136 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: exception: Flavor 84 could not be found. Aug 17 23:37:24.062136 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: action_args: {'id': '84'} Aug 17 23:37:24.062136 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:37:24.062136 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:37:24.063190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 23:37:24.063190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 23:37:24.063190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 23:37:24.063190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 23:37:24.063190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 23:37:24.063190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 23:37:24.063190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 23:37:24.063190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 23:37:24.063190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 23:37:24.063190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:37:24.063190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 23:37:24.063190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 23:37:24.063190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 17 23:37:24.063190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Aug 17 23:37:24.063190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:37:24.063190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Aug 17 23:37:24.063190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:37:24.063190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:37:24.063190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:37:24.064711 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:37:24.064711 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:37:24.064711 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:37:24.064711 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:37:24.064711 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 23:37:24.064711 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:37:24.064711 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 17 23:37:24.064711 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Aug 17 23:37:24.064711 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:37:24.064711 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Aug 17 23:37:24.064711 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:37:24.064711 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:37:24.064711 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:37:24.064711 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:37:24.064711 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:37:24.064711 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 17 23:37:24.064711 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Aug 17 23:37:24.064711 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-24517fff-01f6-4fa2-a5c7-fa292dc5586c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=116280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:37:24.065919 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-24517fff-01f6-4fa2-a5c7-fa292dc5586c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011767 Aug 17 23:37:24.065919 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 24/47] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Aug 17 23:37:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 23:37:25.017521 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-80c4417f-b3f1-4b97-af23-8cd5460afba5 admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:25.018510 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-80c4417f-b3f1-4b97-af23-8cd5460afba5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Aug 17 23:37:25.018897 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 24/48] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 17 23:37:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:37:25.535621 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-fdbca567-f112-490a-a418-9bed26c18790 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:25.541406 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.wsgi [None req-fdbca567-f112-490a-a418-9bed26c18790 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-fdbca567-f112-490a-a418-9bed26c18790 admin admin] Request method failure captured: Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Accept: application/json Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Accept-Encoding: gzip, deflate Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Connection: keep-alive Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Content-Length: 0 Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Host: 10.222.0.26 Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Openstack-Api-Version: compute 2.90 Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Openstack-System-Scope: None Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: User-Agent: python-novaclient Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Auth-Token: gAAAAABi_Xu0sKfavA5o2Ufsd7YUGkIvAjlVYjg8CZIBuk3PkyLqSDRZ_1Cu5HepDrzFui3-kbx-NO8JoCVUTk0XbJfytNt_c1MIzIOFbEi20GYrwJekkAvFhNfNPLyb2EootpBfr7aHl1CPFHujU0MKBc7uBXJoM2ht9nkdg6IT7Ra7memuGfs Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Domain-Id: None Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Domain-Name: None Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Identity-Status: Confirmed Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Is-Admin-Project: True Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Project-Domain-Id: default Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Project-Domain-Name: Default Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Project-Id: fd475051e9cd456abbb6cff649b374cc Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Project-Name: admin Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Role: member,admin,reader Aug 17 23:37:25.542911 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Roles: member,admin,reader Aug 17 23:37:25.544521 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fd475051e9cd456abbb6cff649b374cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fd475051e9cd456abbb6cff649b374cc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd475051e9cd456abbb6cff649b374cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd475051e9cd456abbb6cff649b374cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:37:25.544521 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Tenant: admin Aug 17 23:37:25.544521 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Tenant-Id: fd475051e9cd456abbb6cff649b374cc Aug 17 23:37:25.544521 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-Tenant-Name: admin Aug 17 23:37:25.544521 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-User: admin Aug 17 23:37:25.544521 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-User-Domain-Id: default Aug 17 23:37:25.544521 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-User-Domain-Name: Default Aug 17 23:37:25.544521 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-User-Id: 8f1a8fbc56c44c829c8dd8013a782220 Aug 17 23:37:25.544521 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: X-User-Name: admin Aug 17 23:37:25.544521 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: method: > Aug 17 23:37:25.544521 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: exception: Flavor 451 could not be found. Aug 17 23:37:25.544521 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: action_args: {'id': '451'} Aug 17 23:37:25.544521 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:37:25.544521 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:37:25.548889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 23:37:25.548889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 23:37:25.548889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 23:37:25.548889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 23:37:25.548889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 23:37:25.548889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 23:37:25.548889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 23:37:25.548889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 23:37:25.548889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 23:37:25.548889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:37:25.548889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 23:37:25.548889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 23:37:25.548889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 17 23:37:25.548889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Aug 17 23:37:25.548889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:37:25.548889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Aug 17 23:37:25.548889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:37:25.548889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:37:25.548889 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:37:25.550194 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:37:25.550194 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:37:25.550194 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:37:25.550194 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:37:25.550194 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 23:37:25.550194 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:37:25.550194 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 17 23:37:25.550194 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Aug 17 23:37:25.550194 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:37:25.550194 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Aug 17 23:37:25.550194 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:37:25.550194 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:37:25.550194 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:37:25.550194 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:37:25.550194 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:37:25.550194 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 17 23:37:25.550194 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: ERROR nova.api.openstack.wsgi Aug 17 23:37:25.550194 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-fdbca567-f112-490a-a418-9bed26c18790 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=116280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:37:25.551427 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-fdbca567-f112-490a-a418-9bed26c18790 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.388895 Aug 17 23:37:25.551427 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 25/49] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Aug 17 23:37:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 23:37:25.554436 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-ccf71cd1-cbd0-4192-bf44-0e524a69bc6d admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:25.569656 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-ccf71cd1-cbd0-4192-bf44-0e524a69bc6d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018801 Aug 17 23:37:25.570169 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 25/50] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Aug 17 23:37:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:37:25.579403 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-663abf59-5801-449f-9811-4c87416b9a51 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:25.594021 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-663abf59-5801-449f-9811-4c87416b9a51 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018045 Aug 17 23:37:25.594536 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 26/51] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Aug 17 23:37:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:37:25.603353 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-f3907649-04fc-4e20-8731-5fa28090a95e admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:25.609013 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.wsgi [None req-f3907649-04fc-4e20-8731-5fa28090a95e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-f3907649-04fc-4e20-8731-5fa28090a95e admin admin] Request method failure captured: Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Accept: application/json Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Accept-Encoding: gzip, deflate Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Connection: keep-alive Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Content-Length: 0 Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Host: 10.222.0.26 Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Openstack-Api-Version: compute 2.90 Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Openstack-System-Scope: None Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: User-Agent: python-novaclient Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Auth-Token: gAAAAABi_Xu0sKfavA5o2Ufsd7YUGkIvAjlVYjg8CZIBuk3PkyLqSDRZ_1Cu5HepDrzFui3-kbx-NO8JoCVUTk0XbJfytNt_c1MIzIOFbEi20GYrwJekkAvFhNfNPLyb2EootpBfr7aHl1CPFHujU0MKBc7uBXJoM2ht9nkdg6IT7Ra7memuGfs Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Domain-Id: None Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Domain-Name: None Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Identity-Status: Confirmed Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Is-Admin-Project: True Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Project-Domain-Id: default Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Project-Domain-Name: Default Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Project-Id: fd475051e9cd456abbb6cff649b374cc Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Project-Name: admin Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Role: member,admin,reader Aug 17 23:37:25.610480 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Roles: member,admin,reader Aug 17 23:37:25.612127 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fd475051e9cd456abbb6cff649b374cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fd475051e9cd456abbb6cff649b374cc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd475051e9cd456abbb6cff649b374cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd475051e9cd456abbb6cff649b374cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:37:25.612127 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Tenant: admin Aug 17 23:37:25.612127 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Tenant-Id: fd475051e9cd456abbb6cff649b374cc Aug 17 23:37:25.612127 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-Tenant-Name: admin Aug 17 23:37:25.612127 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-User: admin Aug 17 23:37:25.612127 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-User-Domain-Id: default Aug 17 23:37:25.612127 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-User-Domain-Name: Default Aug 17 23:37:25.612127 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-User-Id: 8f1a8fbc56c44c829c8dd8013a782220 Aug 17 23:37:25.612127 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: X-User-Name: admin Aug 17 23:37:25.612127 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: method: > Aug 17 23:37:25.612127 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: exception: Flavor 451 could not be found. Aug 17 23:37:25.612127 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: action_args: {'id': '451'} Aug 17 23:37:25.612127 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:37:25.612127 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:37:25.613080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 23:37:25.613080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 23:37:25.613080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 23:37:25.613080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 23:37:25.613080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 23:37:25.613080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 23:37:25.613080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 23:37:25.613080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 23:37:25.613080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 23:37:25.613080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:37:25.613080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 23:37:25.613080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 23:37:25.613080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 17 23:37:25.613080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Aug 17 23:37:25.613080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:37:25.613080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Aug 17 23:37:25.613080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:37:25.613080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:37:25.613080 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:37:25.614142 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:37:25.614142 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:37:25.614142 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:37:25.614142 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:37:25.614142 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 23:37:25.614142 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:37:25.614142 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 17 23:37:25.614142 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Aug 17 23:37:25.614142 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:37:25.614142 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Aug 17 23:37:25.614142 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:37:25.614142 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:37:25.614142 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:37:25.614142 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:37:25.614142 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:37:25.614142 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 17 23:37:25.614142 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: ERROR nova.api.openstack.wsgi Aug 17 23:37:25.614142 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-f3907649-04fc-4e20-8731-5fa28090a95e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=116279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:37:25.615135 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-f3907649-04fc-4e20-8731-5fa28090a95e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011854 Aug 17 23:37:25.615135 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 26/52] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Aug 17 23:37:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 17 23:37:26.580740 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-663abf59-5801-449f-9811-4c87416b9a51 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:26.581754 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-663abf59-5801-449f-9811-4c87416b9a51 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 17 23:37:26.582156 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 27/53] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 17 23:37:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:37:27.113399 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-4406c0ec-eca2-457a-abb2-89e71844c518 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:37:27.132865 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-4406c0ec-eca2-457a-abb2-89e71844c518 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.411609 Aug 17 23:37:27.133405 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 27/54] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Aug 17 23:37:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 23:37:28.082870 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-663abf59-5801-449f-9811-4c87416b9a51 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:28.083901 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-663abf59-5801-449f-9811-4c87416b9a51 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 17 23:37:28.084345 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 28/55] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 17 23:37:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:37:28.604593 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-156aa6fd-560a-48d4-9238-2d344fb75838 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:37:28.623789 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-156aa6fd-560a-48d4-9238-2d344fb75838 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.401693 Aug 17 23:37:28.624927 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 28/56] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Aug 17 23:37:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 23:37:29.578609 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-663abf59-5801-449f-9811-4c87416b9a51 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:29.579594 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-663abf59-5801-449f-9811-4c87416b9a51 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Aug 17 23:37:29.580008 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 29/57] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 17 23:37:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:37:30.096141 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-ee4cc17c-fcb3-451a-a313-644389a84d91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:37:30.115797 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-ee4cc17c-fcb3-451a-a313-644389a84d91 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.400812 Aug 17 23:37:30.116368 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 29/58] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Aug 17 23:37:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 23:37:31.078293 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-663abf59-5801-449f-9811-4c87416b9a51 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:31.079306 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-663abf59-5801-449f-9811-4c87416b9a51 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001985 Aug 17 23:37:31.079697 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 30/59] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 17 23:37:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:37:31.594774 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-b202b828-1bb9-49e6-9066-a1f4c6337cfb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:37:31.613403 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-b202b828-1bb9-49e6-9066-a1f4c6337cfb admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.398320 Aug 17 23:37:31.613943 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 30/60] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Aug 17 23:37:31 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 23:37:32.569162 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-663abf59-5801-449f-9811-4c87416b9a51 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:32.570221 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-663abf59-5801-449f-9811-4c87416b9a51 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 17 23:37:32.570622 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 31/61] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 17 23:37:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:37:33.088937 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-de72a017-f292-4135-8bcb-9a69ab5e007d admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:37:33.109418 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-de72a017-f292-4135-8bcb-9a69ab5e007d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.396279 Aug 17 23:37:33.109954 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 31/62] 10.222.0.26 () {60 vars in 1202 bytes} [Wed Aug 17 23:37:32 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:38:25.757591 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-663abf59-5801-449f-9811-4c87416b9a51 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:38:25.758596 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-663abf59-5801-449f-9811-4c87416b9a51 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 17 23:38:25.758992 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 32/63] 10.222.0.26 () {54 vars in 931 bytes} [Wed Aug 17 23:38:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:38:25.769593 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG dbcounter [-] [116279] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=116279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:38:26.140638 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-4eb0e2ed-af21-4d44-b2dd-efc6368e2fdb admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:38:26.161501 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-4eb0e2ed-af21-4d44-b2dd-efc6368e2fdb admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.396363 Aug 17 23:38:26.162039 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 32/64] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Aug 17 23:38:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:38:26.183605 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG dbcounter [-] [116280] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=116280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:38:26.187366 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-def3c457-d966-49bc-99f5-70857ce8dbbf admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:38:26.195451 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-def3c457-d966-49bc-99f5-70857ce8dbbf admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013381 Aug 17 23:38:26.195953 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 33/65] 10.222.0.26 () {60 vars in 1283 bytes} [Wed Aug 17 23:38:26 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:38:26.207781 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-6b98196c-5afe-4926-8823-020241192ce6 admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:38:26.215422 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-6b98196c-5afe-4926-8823-020241192ce6 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011592 Aug 17 23:38:26.215948 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 33/66] 10.222.0.26 () {60 vars in 1286 bytes} [Wed Aug 17 23:38:26 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:38:26.227918 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-ea1a6ba1-8d11-41b9-9b0a-a13b8ca0fa66 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:38:26.236257 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-ea1a6ba1-8d11-41b9-9b0a-a13b8ca0fa66 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012086 Aug 17 23:38:26.236769 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 34/67] 10.222.0.26 () {60 vars in 1286 bytes} [Wed Aug 17 23:38:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:38:26.248102 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-efb58630-28bb-4ffd-85a8-89c2c3d50f11 admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:38:26.255725 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-efb58630-28bb-4ffd-85a8-89c2c3d50f11 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011390 Aug 17 23:38:26.256277 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 34/68] 10.222.0.26 () {60 vars in 1283 bytes} [Wed Aug 17 23:38:26 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:41:17.335449 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-ea1a6ba1-8d11-41b9-9b0a-a13b8ca0fa66 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:41:17.336484 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-ea1a6ba1-8d11-41b9-9b0a-a13b8ca0fa66 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 17 23:41:17.336875 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 35/69] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 17 23:41:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:41:17.477440 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG dbcounter [-] [116279] Writing DB stats nova_api:SELECT=6 {{(pid=116279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:41:17.631040 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-e1795902-bd11-4f74-9c80-75d1937cb904 admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:41:17.633446 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:41:17.633446 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: warnings.warn(msg) Aug 17 23:41:17.634585 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-e1795902-bd11-4f74-9c80-75d1937cb904 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:41:17.635049 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-e1795902-bd11-4f74-9c80-75d1937cb904 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:41:17.635466 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-e1795902-bd11-4f74-9c80-75d1937cb904 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:41:17.636192 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-e1795902-bd11-4f74-9c80-75d1937cb904 admin admin] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:41:17.636629 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-e1795902-bd11-4f74-9c80-75d1937cb904 admin admin] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:41:17.637034 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-e1795902-bd11-4f74-9c80-75d1937cb904 admin admin] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:41:17.670793 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-e1795902-bd11-4f74-9c80-75d1937cb904 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.194796 Aug 17 23:41:17.671332 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 35/70] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Aug 17 23:41:17 2022] GET /compute/v2.1/os-services => generated 794 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 23:41:18.491373 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-ea1a6ba1-8d11-41b9-9b0a-a13b8ca0fa66 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:41:18.492404 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-ea1a6ba1-8d11-41b9-9b0a-a13b8ca0fa66 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 17 23:41:18.492796 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 36/71] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 17 23:41:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:41:18.682021 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-3cea73cc-6868-4dc1-93c2-3b1bdd869851 admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:41:18.684416 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:41:18.684416 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: warnings.warn(msg) Aug 17 23:41:18.685543 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-3cea73cc-6868-4dc1-93c2-3b1bdd869851 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:41:18.686018 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-3cea73cc-6868-4dc1-93c2-3b1bdd869851 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:41:18.686444 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-3cea73cc-6868-4dc1-93c2-3b1bdd869851 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:41:18.687151 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-3cea73cc-6868-4dc1-93c2-3b1bdd869851 admin admin] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:41:18.687594 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-3cea73cc-6868-4dc1-93c2-3b1bdd869851 admin admin] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:41:18.688029 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-3cea73cc-6868-4dc1-93c2-3b1bdd869851 admin admin] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:41:18.707592 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-3cea73cc-6868-4dc1-93c2-3b1bdd869851 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076933 Aug 17 23:41:18.708138 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 36/72] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Aug 17 23:41:18 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 23:41:29.927163 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-ea1a6ba1-8d11-41b9-9b0a-a13b8ca0fa66 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:41:29.928190 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-ea1a6ba1-8d11-41b9-9b0a-a13b8ca0fa66 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Aug 17 23:41:29.928582 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 37/73] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 17 23:41:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:41:30.072398 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG dbcounter [-] [116279] Writing DB stats nova_cell0:SELECT=4 {{(pid=116279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:41:30.073114 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG dbcounter [-] [116279] Writing DB stats nova_cell1:SELECT=4 {{(pid=116279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:41:30.073718 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG dbcounter [-] [116279] Writing DB stats nova_api:SELECT=8 {{(pid=116279) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:41:30.120607 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-5b4d3e51-df89-48e1-8192-89f68a30149b admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:41:30.123467 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:41:30.123467 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: warnings.warn(msg) Aug 17 23:41:30.124619 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-5b4d3e51-df89-48e1-8192-89f68a30149b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:41:30.125119 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-5b4d3e51-df89-48e1-8192-89f68a30149b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:41:30.125545 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-5b4d3e51-df89-48e1-8192-89f68a30149b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:41:30.126259 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-5b4d3e51-df89-48e1-8192-89f68a30149b admin admin] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:41:30.126704 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-5b4d3e51-df89-48e1-8192-89f68a30149b admin admin] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:41:30.127119 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-5b4d3e51-df89-48e1-8192-89f68a30149b admin admin] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:41:30.151994 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-5b4d3e51-df89-48e1-8192-89f68a30149b admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083944 Aug 17 23:41:30.152471 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 37/74] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Aug 17 23:41:30 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:41:30.982672 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: DEBUG nova.api.openstack.wsgi [None req-ea1a6ba1-8d11-41b9-9b0a-a13b8ca0fa66 admin admin] Calling method '>' {{(pid=116280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:41:30.983671 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: INFO nova.api.openstack.requestlog [None req-ea1a6ba1-8d11-41b9-9b0a-a13b8ca0fa66 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Aug 17 23:41:30.984093 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: [pid: 116280|app: 0|req: 38/75] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Aug 17 23:41:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:41:31.173823 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG nova.api.openstack.wsgi [None req-0237a9b5-bbd2-4371-9a75-df04e46b6ac9 admin admin] Calling method '>' {{(pid=116279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:41:31.176200 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:41:31.176200 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: warnings.warn(msg) Aug 17 23:41:31.177304 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-0237a9b5-bbd2-4371-9a75-df04e46b6ac9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:41:31.177776 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-0237a9b5-bbd2-4371-9a75-df04e46b6ac9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:41:31.178200 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-0237a9b5-bbd2-4371-9a75-df04e46b6ac9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:41:31.178909 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-0237a9b5-bbd2-4371-9a75-df04e46b6ac9 admin admin] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:41:31.179354 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-0237a9b5-bbd2-4371-9a75-df04e46b6ac9 admin admin] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:41:31.179768 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: DEBUG oslo_concurrency.lockutils [None req-0237a9b5-bbd2-4371-9a75-df04e46b6ac9 admin admin] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116279) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:41:31.201182 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: INFO nova.api.openstack.requestlog [None req-0237a9b5-bbd2-4371-9a75-df04e46b6ac9 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.078354 Aug 17 23:41:31.201726 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: [pid: 116279|app: 0|req: 38/76] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Aug 17 23:41:31 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:42:28.360861 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: Wed Aug 17 23:42:28 2022 - graceful shutdown triggered... Aug 17 23:42:28.360995 dv-cinder-820027-20-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 17 23:42:28.361943 dv-cinder-820027-20-iscsi devstack@n-api.service[116279]: Gracefully killing worker 1 (pid: 116279)... Aug 17 23:42:28.362354 dv-cinder-820027-20-iscsi devstack@n-api.service[116280]: Gracefully killing worker 2 (pid: 116280)... Aug 17 23:42:29.363045 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: worker 1 buried after 1 seconds Aug 17 23:42:29.363580 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: worker 2 buried after 1 seconds Aug 17 23:42:29.363580 dv-cinder-820027-20-iscsi devstack@n-api.service[116278]: goodbye to uWSGI. Aug 17 23:42:29.364696 dv-cinder-820027-20-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 17 23:42:29.365281 dv-cinder-820027-20-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 17 23:42:29.368037 dv-cinder-820027-20-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 17 23:42:29.376969 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 17 23:42:29.378924 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 23:42:29 2022] *** Aug 17 23:42:29.379100 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 23:42:29.379232 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 23:42:29.379347 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: nodename: dv-cinder-820027-20-iscsi Aug 17 23:42:29.379463 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: machine: x86_64 Aug 17 23:42:29.379572 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: clock source: unix Aug 17 23:42:29.379678 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: pcre jit disabled Aug 17 23:42:29.379786 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: detected number of CPU cores: 4 Aug 17 23:42:29.379893 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: current working directory: / Aug 17 23:42:29.380038 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: detected binary path: /usr/bin/uwsgi-core Aug 17 23:42:29.380164 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: your processes number limit is 47680 Aug 17 23:42:29.380286 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: your memory page size is 4096 bytes Aug 17 23:42:29.380397 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: detected max file descriptor number: 2048 Aug 17 23:42:29.380506 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: lock engine: pthread robust mutexes Aug 17 23:42:29.380790 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: thunder lock: enabled Aug 17 23:42:29.381102 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 17 23:42:29.381223 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 23:42:29.421602 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: Python main interpreter initialized at 0x55cf9743c9c0 Aug 17 23:42:29.421602 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: python threads support enabled Aug 17 23:42:29.421602 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: your server socket listen backlog is limited to 100 connections Aug 17 23:42:29.421602 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: your mercy for graceful operations on workers is 90 seconds Aug 17 23:42:29.422005 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 23:42:29.422094 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: *** Operational MODE: preforking *** Aug 17 23:42:29.422287 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: *** uWSGI is running in multiple interpreter mode *** Aug 17 23:42:29.422287 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: spawned uWSGI master process (pid: 131381) Aug 17 23:42:29.422492 dv-cinder-820027-20-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 17 23:42:29.423589 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: spawned uWSGI worker 1 (pid: 131394, cores: 1) Aug 17 23:42:29.423589 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: spawned uWSGI worker 2 (pid: 131395, cores: 1) Aug 17 23:42:29.423589 dv-cinder-820027-20-iscsi devstack@n-api.service[131381]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 23:42:30.097293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 23:42:30.099342 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 23:42:31.237808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 23:42:31.237808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: from cryptography.utils import int_from_bytes Aug 17 23:42:31.238567 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 23:42:31.238567 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: from cryptography.utils import int_from_bytes Aug 17 23:42:31.269961 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 23:42:31.269961 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: from cryptography.utils import int_from_bytes Aug 17 23:42:31.270577 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 23:42:31.270577 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: from cryptography.utils import int_from_bytes Aug 17 23:42:33.511054 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 23:42:33.512324 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 23:42:33.512491 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 23:42:33.512863 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 23:42:33.513124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 23:42:33.513511 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.513839 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.514159 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.514482 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.514811 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.515122 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.515450 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.515766 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.516116 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.516378 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.516692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.517016 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-20-iscsi {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.517338 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.517646 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.517964 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.518282 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.518585 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.518906 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.519209 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.519708 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.520171 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.520479 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.520790 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.521126 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.521439 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.521748 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.522069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.522377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.522700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.523008 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.523403 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-20-iscsi {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.523716 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.524049 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.524377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.524772 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.525083 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.525391 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.525709 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.526029 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.526336 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.526660 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.527006 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.527324 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.527642 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.527948 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.528276 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.528586 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.528905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.529209 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.529513 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.529765 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.530073 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.530394 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.530712 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.531032 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.531283 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.531533 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.531850 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.532196 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.532506 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.532816 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.533120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.533426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.533732 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.534289 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.534597 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.534903 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.535220 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.535532 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.535850 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.536178 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.536500 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.536893 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.537144 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.537452 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.537793 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.538110 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.538418 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.538734 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.539054 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.539361 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.539668 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.539991 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.540531 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.540876 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.541184 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.541438 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.541743 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.542049 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.542368 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.542704 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.543016 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.543328 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.543631 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.543935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.544271 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.544577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.545038 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.545352 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.545659 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.545967 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.546273 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.546579 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.546897 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.547214 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.547523 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.547834 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.548170 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.548475 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.548794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.549207 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.549409 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.549720 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.550027 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.550334 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.550650 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.550958 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.551264 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.551580 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.551881 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.552217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.552533 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.552841 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.553152 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.553457 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.553760 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.554064 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.554367 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.554669 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.554971 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.555284 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.555589 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.555909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.556243 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.556551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.556879 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.557174 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.557512 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.557847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.558723 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.559043 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.559377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.559707 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.560051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.560366 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.560679 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.561003 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.561316 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.561627 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.561939 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.562259 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.562577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.562908 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.563227 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.563544 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.563864 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.564206 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.564525 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.564854 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.565177 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.565486 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.565824 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.566167 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.566479 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.566806 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.567125 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.567451 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.567751 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.568126 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.568414 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.568747 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.569058 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.569380 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.569689 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.570001 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.570316 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.570630 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.570940 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.571277 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.571590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.571904 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.572254 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.572573 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.572888 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.573203 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.573518 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.574457 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.574810 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.575110 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.576027 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.576027 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.576199 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.576381 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.576689 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.577028 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.577338 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.577653 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.577966 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.578279 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.578591 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.578905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.579219 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.579524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.579849 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.580184 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.580492 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.580818 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.581125 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.581458 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.581852 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.582054 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.582367 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.582680 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.583017 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.583507 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.583703 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.584044 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.584420 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.584804 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.585102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.585497 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.585836 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.586158 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.586467 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.586778 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.587086 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.587395 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.587693 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.588024 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.588338 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.588642 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.588973 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.589241 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.589570 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.589899 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.590207 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.590509 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.590813 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.591134 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.591460 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.591800 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.592132 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.592489 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.592793 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.593114 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.593427 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.593744 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.594058 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.594374 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.594683 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.595000 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.595321 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.595634 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.595951 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.596288 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.596612 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.596923 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.597243 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.597545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.597864 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.598203 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.598543 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.598863 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.599184 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.599495 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.599812 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.600146 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.600460 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.600771 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.601085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.601404 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.601717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.602036 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.602347 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.602672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.602987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.603304 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.603608 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.603924 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.604277 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.604610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.604923 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.605263 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.605588 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.605902 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.606213 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.606528 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.606838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.607145 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.607461 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.607778 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.608114 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.608435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.608741 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.609059 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.609395 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.609700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.610005 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.610320 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.610640 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.610951 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.611272 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.611594 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.611902 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.612242 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.612566 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.612877 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.613108 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 23:42:33.613682 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.613860 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 23:42:33.614013 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.614013 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.614303 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 23:42:33.614487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.614634 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 23:42:33.614779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.614930 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 23:42:33.615086 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.615238 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.615392 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.615537 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.615683 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.615827 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.616009 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.616175 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.616344 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.616497 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.616648 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.616793 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.616936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.617093 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.617246 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.617397 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.617633 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.617810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.618182 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.618350 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.618498 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.618662 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.618807 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.619078 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-20-iscsi {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.619235 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.619491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.619643 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.619797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.621250 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.621419 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.621580 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.621728 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.621880 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.622026 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.622192 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.622347 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.622504 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.622650 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.622793 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.622793 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.623065 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.623065 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.623475 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.623622 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.623766 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.623938 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.624235 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.624525 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.624700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.624849 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.625000 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.625145 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.625289 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.625447 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.625594 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.625738 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.625889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.626045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.626197 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.626355 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.626511 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.626511 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.626810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-20-iscsi {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.626966 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.627131 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.627288 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.627504 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.627688 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.627922 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.628330 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.628506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.628663 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.628810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.628965 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.629110 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.629253 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.629404 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.629632 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.629861 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.630010 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.630154 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.630298 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.630298 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.630592 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.630751 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.630898 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.631049 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.631194 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.631357 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.631590 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.631750 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.631897 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.632065 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.632211 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.632366 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.632527 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.632686 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.632843 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.632990 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.633134 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.633304 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.633534 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.633684 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.633837 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.633990 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.634146 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.634146 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.634437 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.634437 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.634724 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.634724 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.635015 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.635160 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.635324 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.635477 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.635631 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.635792 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.635945 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.636137 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.636895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.637067 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.637222 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.637376 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.637554 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.637715 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.637892 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.638132 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.638506 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.638660 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.638805 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.638960 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.639105 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.639263 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.639416 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.639569 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.639805 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.640019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.640173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.640330 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.640492 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.640647 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.640801 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.640954 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.641129 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.641129 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.641425 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.641598 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.641845 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.642005 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.642150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.642296 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.642440 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.642590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.642774 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.642934 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.643087 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.643233 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.643378 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.643559 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.643776 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.643932 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.644122 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.644277 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.644439 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.644594 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.644748 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.644893 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.645038 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.645181 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.645325 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.645484 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.645647 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.645808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.645969 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.646122 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.646274 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.646429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.646575 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.646718 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.646874 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.647019 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.647176 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.647322 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.647476 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.647631 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.647782 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.647935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.648138 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.648382 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.648765 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.648914 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.649058 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.649205 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.649330 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.649472 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.649611 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.649959 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.650100 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.650231 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.651602 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.651826 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.652206 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.652368 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.652516 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.652670 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.652829 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.652975 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.653120 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.653264 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.653432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.653589 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.653761 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.653995 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.654148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.654301 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.654447 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.654600 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.654746 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.654899 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.655054 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.655207 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.655207 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.655509 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.655663 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.655816 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.655991 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.656145 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.656301 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.656448 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.656601 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.656746 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.656901 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.657048 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.657192 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.657343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.657499 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.657658 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.657814 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.658006 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.658168 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.658337 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.658814 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.658987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.659398 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.659543 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.659697 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.659849 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.660123 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.660291 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.660447 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.660592 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.660758 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.661142 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.661296 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.661458 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.661604 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.661756 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.661756 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.662039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.662204 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.662577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.662739 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.662893 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.663039 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.663182 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.663342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.663489 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.663633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.663776 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.663927 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.664171 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.664335 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.664481 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.664638 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.664790 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.664934 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:42:33.665087 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.665087 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.665380 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.665526 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.665670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.665821 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.665973 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.666127 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.666279 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.666425 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.666587 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.666749 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.666904 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.667050 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.667201 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.667353 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.667507 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.667695 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.667850 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.668041 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.668284 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.668458 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.668731 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.669122 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.669281 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.669434 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.669581 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.669726 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.669878 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.670034 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.670262 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.670423 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.670577 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.670724 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.670869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.671035 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.671189 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.671334 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.671487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.671632 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.671777 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.671932 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.672102 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.672258 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.672414 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.672673 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.672825 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.672984 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.673141 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.673294 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.673446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.673599 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.673599 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.674691 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.674691 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.675012 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.675166 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.675325 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.675502 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.675666 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.675839 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.676013 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.676173 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.676325 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.676536 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.676717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.676889 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.677044 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.677195 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.677355 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.677507 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.677657 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.677657 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.677967 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.678118 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.678278 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.678431 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.678592 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.678834 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.679158 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.679158 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.679568 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.679723 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.679874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.680082 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.680271 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.680513 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.680680 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.680841 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.680994 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.681154 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.681305 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.681465 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.681625 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.681778 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.681936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.682088 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.682248 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.682420 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.682573 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.682826 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.682993 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.683673 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.683844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.684030 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.684191 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.684440 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.684608 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.684761 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.684921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.685089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.685263 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.685418 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.685577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.685729 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.685891 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.686057 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.686210 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.686363 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.686522 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.686680 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.686842 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.686994 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.687153 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.687316 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.687476 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.687628 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.687793 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.687953 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.688159 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.688313 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.688474 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.688633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.690127 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.690310 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.690497 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.690734 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.690908 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.691112 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.691278 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.691431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.691585 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.691744 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.691908 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.692107 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.692263 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.692416 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.692567 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.692719 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.692986 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.693160 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.693314 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.693465 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.693619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.693779 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.693932 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.694097 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.694258 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.694438 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.694666 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.694825 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.694993 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.695163 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.695325 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.695478 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.695630 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.695783 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.695943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.696151 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.696305 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.696518 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.696813 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.696981 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.697150 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.697311 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.697476 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.697627 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.697779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.697932 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.698098 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.698266 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.698420 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.698571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.698730 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.699529 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.699692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.699845 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.700313 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.700500 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.700663 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.700909 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.701078 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.701239 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.701392 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.701544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.701694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.701856 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.702008 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.702168 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.702329 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.702493 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.702653 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.702816 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.702997 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.703239 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.703395 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.703553 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.703715 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.703875 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.704089 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.704248 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.704418 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.704571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.704826 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.704995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.705334 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.705498 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.705660 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.705855 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.706054 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.706238 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.706407 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.706561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.706713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.706873 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.707036 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.707210 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.707365 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.707517 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.707696 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.707981 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.708145 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.708145 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.708463 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.708616 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.708768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.708934 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.709094 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.709247 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.709415 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.709568 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.709727 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.709894 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.710054 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.710551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.710715 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.710896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.711127 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.711303 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.711466 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.711621 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.711792 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.711953 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.712141 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.712312 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.712467 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.712619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.712778 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.712938 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.713143 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.713400 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.713560 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.713867 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.714072 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.714253 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.714453 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.714620 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.714775 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.715023 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.715182 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.715182 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.715491 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.715653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.715807 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.716001 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.716173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.716334 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.716508 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.716662 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.716822 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.716976 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.717136 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.717297 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.717450 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.717602 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.717754 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.717914 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.718075 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.718237 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.718399 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.718564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.718716 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.718877 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.719029 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.719189 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.719341 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.719510 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.719694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.719849 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.720037 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.720198 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.720660 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.720845 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.721009 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.721252 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.721427 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.721582 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.721742 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.721896 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.722050 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.722205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.722371 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.722524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.722676 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.722840 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.722999 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.723162 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.723314 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.723568 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.724574 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.724744 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.724900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.725156 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.725328 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.725489 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.725650 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.725804 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.725978 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.726145 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.726308 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.726462 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.726613 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.726765 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.726924 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.727086 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.727240 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.727392 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.727544 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.727695 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.727872 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.728070 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.728230 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.728391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.728544 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.728695 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.728860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.729021 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.729174 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.729332 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.729486 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.729637 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.729798 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.729969 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.730158 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.730320 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.730475 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.730959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.731125 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.731362 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.731522 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.731674 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.731837 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.732024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.732185 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.732479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.732655 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.732810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.732961 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.733127 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.733288 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.733441 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.733610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.733863 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.734028 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.734197 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.734388 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.734688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.734879 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.735166 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.735406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.735581 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.735744 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.735906 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.736144 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.736301 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.736301 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.736615 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.736778 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.736939 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.737100 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.737272 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.737441 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.737595 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.737595 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.737900 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.738053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.738212 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.738379 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.738532 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.738683 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.738835 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.738988 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.739149 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.739313 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.739465 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.739625 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.739785 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.739939 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.740135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.740298 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.740452 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.740621 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.741172 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.741356 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.741356 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.741743 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.741905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.742075 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.742243 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.742396 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.742556 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.742717 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.742884 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.743038 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.743198 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.743358 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.743509 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.743660 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.743850 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.744127 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.744381 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.744540 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.744691 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.744860 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.745025 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.745179 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.745331 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.745569 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.746282 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.746449 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.746623 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.746828 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.746986 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.747138 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.747290 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.747458 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.747619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.747771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.747922 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.748132 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.748286 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.748455 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.748609 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.748761 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.748931 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.749084 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.749251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.749417 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.749570 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.749730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.749890 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.750050 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.750213 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.750375 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.750529 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.750681 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.750870 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.751320 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.751498 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.751735 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.751904 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.752083 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.752236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.752389 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.752555 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.752717 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.752717 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.753018 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.753170 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.753342 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.753497 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.753649 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.753809 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.753978 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.754157 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.754408 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.754569 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.754727 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.754892 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.755054 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.755222 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.755390 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.755582 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.755814 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.755999 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.756159 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.756327 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.756482 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.756635 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.756794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.756954 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.757115 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.757281 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.757442 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.757606 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.757760 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.757920 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.758080 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.758242 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.758395 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.758547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.758707 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.758859 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.759012 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.759176 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.759336 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.759496 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.759666 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.759820 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.760011 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.760184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.760338 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.760489 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.760652 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.760816 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.760978 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.761149 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.762216 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.762371 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.762533 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.762698 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.762861 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.763015 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.763175 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.763338 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.763491 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.763644 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.763809 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.763992 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.764154 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.764306 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.764573 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.764823 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.764985 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.765138 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.765299 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.765463 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.765617 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.765802 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.766027 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.766193 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.766347 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.766507 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.766660 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.766822 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.766991 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.767156 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.767156 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.767455 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.767617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.767770 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.767930 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.768144 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.768439 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.768669 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.768848 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.769005 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.769178 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.769332 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.769493 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.769646 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.769807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.769969 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.770122 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.770283 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.770443 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.770604 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.770772 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.775375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.775617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.775812 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.776164 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.776359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.776541 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.776837 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.777053 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.777222 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.777385 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.777551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.777718 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.777880 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.778034 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.778186 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.778352 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.778515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.778679 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.778841 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.779003 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.779164 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.779164 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.779465 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.779619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.779772 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.779933 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.780125 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.780298 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.780466 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.780627 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.780788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.780942 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.781102 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.781265 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.781426 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.781580 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.781732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.781885 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.782037 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.782199 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.782364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.782525 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.782688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.782843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.783011 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.783174 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.783337 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.783491 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.783653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.783805 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.784981 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.785164 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.785319 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.785486 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.785640 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.785793 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.785960 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.786124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.786402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.786560 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.786724 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.786878 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.787042 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.787198 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.787359 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.787512 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.787686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.787849 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.788040 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.788203 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.788358 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.788510 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.788661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.788822 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.788985 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.789138 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.789291 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.789458 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.789632 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.789795 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.789957 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.790111 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.790271 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.790425 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.790584 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.790747 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.790901 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.791274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.791435 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.791589 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.791751 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.791917 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.792110 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.792266 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.792418 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.792611 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.792817 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.792987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.793161 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.793926 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.794096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.794251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.794418 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.795335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.795519 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.795691 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.795856 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.796061 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.796239 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.796413 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.796678 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.796846 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.797001 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.797167 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.797331 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.797494 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.797660 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.797820 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.797973 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.798141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.798304 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.798458 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.798611 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.798763 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.798923 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.799085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.799239 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.799391 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.799552 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.799727 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.799895 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.800090 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.800247 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.800400 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.800552 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.800714 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.800877 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.801040 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.801194 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.801353 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.801514 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.801688 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.801688 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.801992 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.802145 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.802304 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.802464 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.802617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.802856 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.803019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.803172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 23:42:33.803333 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.803333 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.803333 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.803333 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.803333 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.803333 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.803333 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.803333 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.804772 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.804772 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.804772 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.804772 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.804772 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.804772 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.804772 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.804772 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.806771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.806771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.806771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.806771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.806771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.806771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.806771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.806771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.807928 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.807928 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.807928 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.807928 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.807928 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.807928 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.807928 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.807928 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.809743 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.809743 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.809743 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.809743 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.809743 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.809743 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.809743 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.809743 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.810888 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.810888 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.810888 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.810888 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.810888 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.810888 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.810888 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.810888 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.812120 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.812120 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.812120 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.812120 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.812120 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.812120 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.812120 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.812120 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.813298 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.813298 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.813298 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.813298 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.813298 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.813298 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.813298 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.813298 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.814537 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.814537 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.814537 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.814537 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.814537 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.814537 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.814537 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.814537 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.816669 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.816669 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.816669 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.816669 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.816669 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.816669 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.816669 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.816669 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.817828 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.817828 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.817828 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.817828 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.817828 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.817828 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.817828 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.817828 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.819013 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.819013 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.819013 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.819013 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.819013 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.819013 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.819013 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.819013 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.820210 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.820210 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.820210 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.820210 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.820210 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.820210 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.820210 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.820210 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.821370 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.821370 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.821370 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.821370 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.821370 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.821370 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.821370 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.822409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.822409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.822409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.822409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.822409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.822409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.822409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.822409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.823561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.823561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.823561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.823561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.823561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.823561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.823561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.823561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.826564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.826564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.826564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.826564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.826564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.826564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.826564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.826564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.828446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.828446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.828446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.828446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.828446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.828446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.828446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.828446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.829619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.829619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.829619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.829619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.829619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.829619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.829619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.829619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.830780 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.830780 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.830780 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.830780 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.830780 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.830780 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.830780 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.830780 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.831941 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.831941 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.831941 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.831941 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.831941 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.831941 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.831941 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.831941 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.833148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.833148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.833148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.833148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.833148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.833148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.833148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.833148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.834293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.834293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.834293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.834293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.834293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.834293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.834293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.834293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.836486 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.836486 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.836486 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.836486 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.836486 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.836486 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.836486 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.836486 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.837656 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.837656 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.837656 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.837656 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.838252 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.838252 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.838550 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.838701 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.839003 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.839320 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.839678 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.840058 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.840329 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.840647 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.840974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.841290 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.841608 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.841922 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.842236 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.842552 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.842867 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.843197 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.843502 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.843861 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.844217 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.844542 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.844866 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.845191 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.845509 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.846150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.846150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.846780 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.846780 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.847079 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.847379 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.847690 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.848159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.848483 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.848808 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.849135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.849453 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.849780 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.850106 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.850424 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.850755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.851071 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.851451 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.852409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.852409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.852409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.852887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.853038 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.853310 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.853610 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.854005 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.854237 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.854546 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.854853 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.855199 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.855631 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.855816 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.856461 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.856461 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.857078 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.857078 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.857407 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.857619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.858028 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.858236 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.858543 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.858857 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.859164 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.859474 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.859781 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.860110 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.860420 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.860773 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.861109 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.861434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.861762 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.862081 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.862408 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.862725 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.863053 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.863380 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.863703 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.864041 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.864385 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.864704 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.865023 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.865341 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.865779 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.865975 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.866581 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.866769 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.866949 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.867369 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.867556 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.867891 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.868341 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.868636 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.868872 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.869209 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.869530 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.869850 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.870168 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.870486 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.871342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.871669 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.872007 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.872329 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.872654 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.872979 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.873311 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.873643 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.873960 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.874292 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.874624 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.874979 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.875298 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.875653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.876003 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.876327 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.876644 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.876955 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:42:33.877206 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 23:42:33.923933 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO dbcounter [None req-c8a44ad6-bc16-42b5-9a55-3e78bff00adb None None] Registered counter for database nova_api Aug 17 23:42:33.945043 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_db.sqlalchemy.engines [None req-c8a44ad6-bc16-42b5-9a55-3e78bff00adb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131395) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 23:42:33.952361 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writer thread running {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 23:42:34.009333 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.context [None req-c8a44ad6-bc16-42b5-9a55-3e78bff00adb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),21568e4d-f90d-40c1-be8c-94bd510fd532(cell1) {{(pid=131395) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 23:42:34.013324 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c8a44ad6-bc16-42b5-9a55-3e78bff00adb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:42:34.013797 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c8a44ad6-bc16-42b5-9a55-3e78bff00adb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:42:34.015357 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c8a44ad6-bc16-42b5-9a55-3e78bff00adb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:42:34.016125 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c8a44ad6-bc16-42b5-9a55-3e78bff00adb None None] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:42:34.016571 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c8a44ad6-bc16-42b5-9a55-3e78bff00adb None None] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:42:34.018632 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c8a44ad6-bc16-42b5-9a55-3e78bff00adb None None] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:42:34.020653 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO dbcounter [None req-c8a44ad6-bc16-42b5-9a55-3e78bff00adb None None] Registered counter for database nova_cell0 Aug 17 23:42:34.024657 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO dbcounter [None req-c8a44ad6-bc16-42b5-9a55-3e78bff00adb None None] Registered counter for database nova_cell1 Aug 17 23:42:34.027410 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO dbcounter [None req-686aa040-90f9-4b5f-9742-c66573b21d82 None None] Registered counter for database nova_api Aug 17 23:42:34.032797 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_db.sqlalchemy.engines [None req-c8a44ad6-bc16-42b5-9a55-3e78bff00adb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131395) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 23:42:34.033945 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_db.sqlalchemy.engines [None req-c8a44ad6-bc16-42b5-9a55-3e78bff00adb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131395) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 23:42:34.038426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writer thread running {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 23:42:34.047530 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_db.sqlalchemy.engines [None req-686aa040-90f9-4b5f-9742-c66573b21d82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131394) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 23:42:34.054215 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writer thread running {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 23:42:34.110522 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.context [None req-686aa040-90f9-4b5f-9742-c66573b21d82 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),21568e4d-f90d-40c1-be8c-94bd510fd532(cell1) {{(pid=131394) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 23:42:34.114484 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-686aa040-90f9-4b5f-9742-c66573b21d82 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:42:34.114965 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-686aa040-90f9-4b5f-9742-c66573b21d82 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:42:34.116578 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-686aa040-90f9-4b5f-9742-c66573b21d82 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:42:34.117322 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-686aa040-90f9-4b5f-9742-c66573b21d82 None None] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:42:34.117771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-686aa040-90f9-4b5f-9742-c66573b21d82 None None] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:42:34.119761 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-686aa040-90f9-4b5f-9742-c66573b21d82 None None] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:42:34.122330 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO dbcounter [None req-686aa040-90f9-4b5f-9742-c66573b21d82 None None] Registered counter for database nova_cell0 Aug 17 23:42:34.126368 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO dbcounter [None req-686aa040-90f9-4b5f-9742-c66573b21d82 None None] Registered counter for database nova_cell1 Aug 17 23:42:34.133734 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_db.sqlalchemy.engines [None req-686aa040-90f9-4b5f-9742-c66573b21d82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131394) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 23:42:34.136057 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_db.sqlalchemy.engines [None req-686aa040-90f9-4b5f-9742-c66573b21d82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131394) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 23:42:34.140754 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writer thread running {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 23:42:34.175065 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writer thread running {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 23:42:34.185409 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO dbcounter [None req-c8a44ad6-bc16-42b5-9a55-3e78bff00adb None None] Registered counter for database nova_cell0 Aug 17 23:42:34.191890 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_db.sqlalchemy.engines [None req-c8a44ad6-bc16-42b5-9a55-3e78bff00adb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131395) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 23:42:34.196295 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writer thread running {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 23:42:34.280054 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writer thread running {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 23:42:34.290813 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO dbcounter [None req-686aa040-90f9-4b5f-9742-c66573b21d82 None None] Registered counter for database nova_cell0 Aug 17 23:42:34.300038 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_db.sqlalchemy.engines [None req-686aa040-90f9-4b5f-9742-c66573b21d82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131394) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 23:42:34.304600 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writer thread running {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 23:42:34.511795 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: WARNING keystonemiddleware.auth_token [None req-c8a44ad6-bc16-42b5-9a55-3e78bff00adb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 23:42:34.519106 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: WARNING keystonemiddleware.auth_token [None req-c8a44ad6-bc16-42b5-9a55-3e78bff00adb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 23:42:34.623493 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: WARNING keystonemiddleware.auth_token [None req-686aa040-90f9-4b5f-9742-c66573b21d82 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 23:42:34.630795 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: WARNING keystonemiddleware.auth_token [None req-686aa040-90f9-4b5f-9742-c66573b21d82 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 23:42:34.860156 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: WARNING keystonemiddleware.auth_token [None req-c8a44ad6-bc16-42b5-9a55-3e78bff00adb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 23:42:34.866513 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: WARNING keystonemiddleware.auth_token [None req-c8a44ad6-bc16-42b5-9a55-3e78bff00adb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 23:42:34.873097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cf9743c9c0 pid: 131395 (default app) Aug 17 23:42:34.975395 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: WARNING keystonemiddleware.auth_token [None req-686aa040-90f9-4b5f-9742-c66573b21d82 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 23:42:34.981594 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: WARNING keystonemiddleware.auth_token [None req-686aa040-90f9-4b5f-9742-c66573b21d82 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 23:42:34.988836 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cf9743c9c0 pid: 131394 (default app) Aug 17 23:43:08.693502 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=3 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:43:08.694343 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=3 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:43:08.695397 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=3 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:43:08.696649 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=3 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:43:09.817002 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-39732344-d9e8-4eeb-87e4-67ea9c55029b tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Action: 'create', calling method: .version_select at 0x7f85ff955280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-877791200"}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:43:10.175293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=3 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:43:10.176709 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=3 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:43:10.177586 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=3 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:43:10.178475 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=3 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:43:11.738322 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b8e721f3-ff3f-468d-b147-bd7830bfa7bc tempest-VolumesGetTestJSON-638985164 tempest-VolumesGetTestJSON-638985164-project] Action: 'create', calling method: .version_select at 0x7f85ff953280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-672754663", "metadata": {"Type": "work"}}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:43:12.220361 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-39732344-d9e8-4eeb-87e4-67ea9c55029b tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.540676 Aug 17 23:43:12.222145 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1155 bytes} [Wed Aug 17 23:43:08 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3544 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 17 23:43:12.238802 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ccb205af-07b1-4a31-9bfa-7985669a2c1b tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Calling method '.version_select at 0x7f85ff7b5160>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:12.584679 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ccb205af-07b1-4a31-9bfa-7985669a2c1b tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b" status: 200 len: 344 microversion: 2.1 time: 0.349988 Aug 17 23:43:12.585947 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 2/2] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 17 23:43:12 2022] GET /compute/v2.1/os-volumes/72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b => generated 344 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:43:13.157638 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b8e721f3-ff3f-468d-b147-bd7830bfa7bc tempest-VolumesGetTestJSON-638985164 tempest-VolumesGetTestJSON-638985164-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.988166 Aug 17 23:43:13.158295 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Aug 17 23:43:10 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2992 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 17 23:43:13.174707 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-6a8aee6b-0081-443d-a235-39ecdbd5bf1b tempest-VolumesGetTestJSON-638985164 tempest-VolumesGetTestJSON-638985164-project] Calling method '.version_select at 0x7f85ff7b5820>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:13.295109 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-6a8aee6b-0081-443d-a235-39ecdbd5bf1b tempest-VolumesGetTestJSON-638985164 tempest-VolumesGetTestJSON-638985164-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/e6597b0c-f699-4b56-b8ed-a50e3d85c65d" status: 200 len: 352 microversion: 2.1 time: 0.124309 Aug 17 23:43:13.304308 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 3/4] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 17 23:43:13 2022] GET /compute/v2.1/os-volumes/e6597b0c-f699-4b56-b8ed-a50e3d85c65d => generated 352 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:43:13.607088 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-620dc1c6-d7ef-465d-9195-b30eeb534df7 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Calling method '.version_select at 0x7f85ff7b3160>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:13.724763 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-620dc1c6-d7ef-465d-9195-b30eeb534df7 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b" status: 200 len: 344 microversion: 2.1 time: 0.126672 Aug 17 23:43:13.726075 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 2/5] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 17 23:43:13 2022] GET /compute/v2.1/os-volumes/72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b => generated 344 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:43:14.310766 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-32c65bf5-5fd5-4846-8170-931c8dbc0741 tempest-VolumesGetTestJSON-638985164 tempest-VolumesGetTestJSON-638985164-project] Calling method '.version_select at 0x7f85ff7b5f70>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:14.392988 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-32c65bf5-5fd5-4846-8170-931c8dbc0741 tempest-VolumesGetTestJSON-638985164 tempest-VolumesGetTestJSON-638985164-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/e6597b0c-f699-4b56-b8ed-a50e3d85c65d" status: 200 len: 353 microversion: 2.1 time: 0.087038 Aug 17 23:43:14.394127 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 4/6] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 17 23:43:14 2022] GET /compute/v2.1/os-volumes/e6597b0c-f699-4b56-b8ed-a50e3d85c65d => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:43:14.406942 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-fadc996f-93d5-4f72-8584-612c0b70879b tempest-VolumesGetTestJSON-638985164 tempest-VolumesGetTestJSON-638985164-project] Calling method '.version_select at 0x7f85ff7b38b0>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:14.514992 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-fadc996f-93d5-4f72-8584-612c0b70879b tempest-VolumesGetTestJSON-638985164 tempest-VolumesGetTestJSON-638985164-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/e6597b0c-f699-4b56-b8ed-a50e3d85c65d" status: 200 len: 353 microversion: 2.1 time: 0.111687 Aug 17 23:43:14.531955 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 3/7] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 17 23:43:14 2022] GET /compute/v2.1/os-volumes/e6597b0c-f699-4b56-b8ed-a50e3d85c65d => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:43:14.546371 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2d9f0950-8c1d-473b-8e3b-364f4e4ac3cd tempest-VolumesGetTestJSON-638985164 tempest-VolumesGetTestJSON-638985164-project] Calling method '.version_select at 0x7f85ff7b5af0>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:14.742972 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e95bb5f3-4251-4ce2-affd-b41eb97796f5 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Calling method '.version_select at 0x7f85ff7b3f70>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:14.878091 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e95bb5f3-4251-4ce2-affd-b41eb97796f5 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b" status: 200 len: 345 microversion: 2.1 time: 0.142668 Aug 17 23:43:14.889250 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2d9f0950-8c1d-473b-8e3b-364f4e4ac3cd tempest-VolumesGetTestJSON-638985164 tempest-VolumesGetTestJSON-638985164-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/e6597b0c-f699-4b56-b8ed-a50e3d85c65d" status: 202 len: 0 microversion: 2.1 time: 0.354715 Aug 17 23:43:14.889828 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 5/8] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Aug 17 23:43:14 2022] DELETE /compute/v2.1/os-volumes/e6597b0c-f699-4b56-b8ed-a50e3d85c65d => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 23:43:14.894337 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 4/9] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 17 23:43:14 2022] GET /compute/v2.1/os-volumes/72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b => generated 345 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:43:14.900346 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1c7c73c8-7fed-42ec-9e18-17d0fba5d41a tempest-VolumesGetTestJSON-638985164 tempest-VolumesGetTestJSON-638985164-project] Calling method '.version_select at 0x7f85ff7b3b80>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:14.907387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-31fa14cc-7f9d-4e1d-b0ed-5de19e3e03bb tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Action: 'create', calling method: .version_select at 0x7f85ff7b54c0>, body: {"snapshot": {"volume_id": "72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1450410004"}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:43:15.007878 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1c7c73c8-7fed-42ec-9e18-17d0fba5d41a tempest-VolumesGetTestJSON-638985164 tempest-VolumesGetTestJSON-638985164-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/e6597b0c-f699-4b56-b8ed-a50e3d85c65d" status: 200 len: 352 microversion: 2.1 time: 0.112370 Aug 17 23:43:15.015358 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 5/10] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 17 23:43:14 2022] GET /compute/v2.1/os-volumes/e6597b0c-f699-4b56-b8ed-a50e3d85c65d => generated 352 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:43:15.511608 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-31fa14cc-7f9d-4e1d-b0ed-5de19e3e03bb tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.617632 Aug 17 23:43:15.530944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 6/11] 10.222.0.26 () {60 vars in 1162 bytes} [Wed Aug 17 23:43:14 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:43:15.531861 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a38bb3db-c613-4bc3-83d9-42344c488c31 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Calling method '.version_select at 0x7f85ff7b3430>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:15.691671 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a38bb3db-c613-4bc3-83d9-42344c488c31 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de" status: 200 len: 287 microversion: 2.1 time: 0.168818 Aug 17 23:43:15.704301 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Aug 17 23:43:15 2022] GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de => generated 287 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:43:15.705009 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-db3ca0bb-ac91-472d-8418-6e725879e567 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Calling method '.version_select at 0x7f85ff7c1940>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:15.859422 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-db3ca0bb-ac91-472d-8418-6e725879e567 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.158374 Aug 17 23:43:15.877126 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1140 bytes} [Wed Aug 17 23:43:15 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:43:15.879856 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e2cabe70-555e-40ea-9e3a-2c015cffe437 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Calling method '.version_select at 0x7f85ff7be0d0>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:15.948011 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e2cabe70-555e-40ea-9e3a-2c015cffe437 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de" status: 200 len: 287 microversion: 2.1 time: 0.079928 Aug 17 23:43:15.948600 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 7/14] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Aug 17 23:43:15 2022] GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:43:16.033396 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a93e4829-acef-4492-94fc-d3ef791dc458 tempest-VolumesGetTestJSON-638985164 tempest-VolumesGetTestJSON-638985164-project] Calling method '.version_select at 0x7f85ff7c1280>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:16.103354 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-a93e4829-acef-4492-94fc-d3ef791dc458 tempest-VolumesGetTestJSON-638985164 tempest-VolumesGetTestJSON-638985164-project] HTTP exception thrown: Volume e6597b0c-f699-4b56-b8ed-a50e3d85c65d could not be found. Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a93e4829-acef-4492-94fc-d3ef791dc458 tempest-VolumesGetTestJSON-638985164 tempest-VolumesGetTestJSON-638985164-project] Request method failure captured: Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/os-volumes/e6597b0c-f699-4b56-b8ed-a50e3d85c65d HTTP/1.1 Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X0OrNwvPi4AKPvzHfzfzyaSFQOXTxSpZvReU-jnDEz_z26HcG0k9iAhVbj45IoGn66UH4uFRMf69LfUsl1wLRpRFLwRH4wLc6SyiMCq1PpFGs6c4zb5lyBUisnPb8UnBx1JD2K6EPCpZ988JkZLOGoFWTUbY3wxMKwFqNrXQZ8Pl94 Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: 5393defca80f4e8e8bfbec7a4305d58d Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-VolumesGetTestJSON-638985164 Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:43:16.108363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:43:16.109317 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5393defca80f4e8e8bfbec7a4305d58d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5393defca80f4e8e8bfbec7a4305d58d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5393defca80f4e8e8bfbec7a4305d58d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5393defca80f4e8e8bfbec7a4305d58d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:43:16.109317 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-VolumesGetTestJSON-638985164 Aug 17 23:43:16.109317 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: 5393defca80f4e8e8bfbec7a4305d58d Aug 17 23:43:16.109317 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-VolumesGetTestJSON-638985164 Aug 17 23:43:16.109317 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-VolumesGetTestJSON-638985164-project Aug 17 23:43:16.109317 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:43:16.109317 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:43:16.109317 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 2c5d003f5caf4437a0e6a892937ed693 Aug 17 23:43:16.109317 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-VolumesGetTestJSON-638985164-project Aug 17 23:43:16.109317 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: Aug 17 23:43:16.109317 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Volume e6597b0c-f699-4b56-b8ed-a50e3d85c65d could not be found. Aug 17 23:43:16.109317 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': 'e6597b0c-f699-4b56-b8ed-a50e3d85c65d'} Aug 17 23:43:16.109317 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:43:16.109909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:43:16.109909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 23:43:16.109909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 23:43:16.109909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 23:43:16.109909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 23:43:16.109909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 23:43:16.109909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 23:43:16.109909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 23:43:16.109909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 23:43:16.109909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 23:43:16.109909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 23:43:16.109909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 23:43:16.109909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 23:43:16.109909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 23:43:16.109909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 23:43:16.109909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e6597b0c-f699-4b56-b8ed-a50e3d85c65d could not be found. (HTTP 404) (Request-ID: req-56eba9fc-50e6-4006-ae54-bb4ef4c25216) Aug 17 23:43:16.109909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:16.109909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:43:16.109909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:16.111217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:43:16.111217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 23:43:16.111217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 23:43:16.111217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 23:43:16.111217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 23:43:16.111217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 23:43:16.111217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 23:43:16.111217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 23:43:16.111217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 23:43:16.111217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 23:43:16.111217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 23:43:16.111217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 23:43:16.111217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 23:43:16.111217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 23:43:16.111217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 23:43:16.111217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 23:43:16.111217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 23:43:16.111217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 23:43:16.111217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 23:43:16.112112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 23:43:16.112112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 23:43:16.112112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 23:43:16.112112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 23:43:16.112112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e6597b0c-f699-4b56-b8ed-a50e3d85c65d could not be found. Aug 17 23:43:16.112112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:16.112112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:43:16.112112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:16.112112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:43:16.112112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:43:16.112112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:43:16.112112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:43:16.112112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:43:16.112112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 23:43:16.112112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 23:43:16.112112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:43:16.112112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:43:16.112112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 23:43:16.112112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:43:16.112987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e6597b0c-f699-4b56-b8ed-a50e3d85c65d could not be found. Aug 17 23:43:16.112987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:16.112987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:43:16.112987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:16.112987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:43:16.112987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:43:16.112987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:43:16.112987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:43:16.112987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:43:16.112987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e6597b0c-f699-4b56-b8ed-a50e3d85c65d could not be found. Aug 17 23:43:16.112987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:16.112987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a93e4829-acef-4492-94fc-d3ef791dc458 tempest-VolumesGetTestJSON-638985164 tempest-VolumesGetTestJSON-638985164-project] Returning 404 to user: Volume e6597b0c-f699-4b56-b8ed-a50e3d85c65d could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:43:16.112987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a93e4829-acef-4492-94fc-d3ef791dc458 tempest-VolumesGetTestJSON-638985164 tempest-VolumesGetTestJSON-638985164-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/e6597b0c-f699-4b56-b8ed-a50e3d85c65d" status: 404 len: 109 microversion: 2.1 time: 0.083355 Aug 17 23:43:16.113999 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 8/15] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 17 23:43:16 2022] GET /compute/v2.1/os-volumes/e6597b0c-f699-4b56-b8ed-a50e3d85c65d => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:43:16.960186 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-3ef165d1-8cdf-4357-a363-f4806f582cb5 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Calling method '.version_select at 0x7f85ff7b3160>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:17.023955 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-3ef165d1-8cdf-4357-a363-f4806f582cb5 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de" status: 200 len: 287 microversion: 2.1 time: 0.067461 Aug 17 23:43:17.026410 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Aug 17 23:43:16 2022] GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:43:18.042955 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-cf4f4fb0-6ca5-4bdf-8326-32abf24c15a1 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Calling method '.version_select at 0x7f8600191700>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:18.126191 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-cf4f4fb0-6ca5-4bdf-8326-32abf24c15a1 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de" status: 200 len: 287 microversion: 2.1 time: 0.086711 Aug 17 23:43:18.127352 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 9/17] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Aug 17 23:43:18 2022] GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:43:19.139353 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f8d3c2c8-b4aa-4e28-b763-221ca6aa1e39 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Calling method '.version_select at 0x7f85ff7b38b0>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:19.201745 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f8d3c2c8-b4aa-4e28-b763-221ca6aa1e39 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de" status: 200 len: 287 microversion: 2.1 time: 0.066824 Aug 17 23:43:19.202919 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 9/18] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Aug 17 23:43:19 2022] GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:43:20.221764 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2811de5b-d5a7-4cab-8ff6-75f2c806dcd1 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Calling method '.version_select at 0x7f85ff7c69d0>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:20.269834 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2811de5b-d5a7-4cab-8ff6-75f2c806dcd1 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de" status: 200 len: 287 microversion: 2.1 time: 0.058051 Aug 17 23:43:20.270741 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 10/19] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Aug 17 23:43:20 2022] GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:43:21.284032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-5c7837ed-43b0-4d1e-a19f-a98e83e9a29e tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Calling method '.version_select at 0x7f85ff7be4c0>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:21.366392 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-5c7837ed-43b0-4d1e-a19f-a98e83e9a29e tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de" status: 200 len: 287 microversion: 2.1 time: 0.087371 Aug 17 23:43:21.367264 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 10/20] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Aug 17 23:43:21 2022] GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:43:22.378958 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-05ee11ae-e724-4d01-8b9a-13c5b25bf16f tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Calling method '.version_select at 0x7f85ff7c6ee0>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:22.443237 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-05ee11ae-e724-4d01-8b9a-13c5b25bf16f tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de" status: 200 len: 288 microversion: 2.1 time: 0.068480 Aug 17 23:43:22.443802 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 11/21] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Aug 17 23:43:22 2022] GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de => generated 288 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:43:22.454844 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8f87573b-a8d0-41b4-a61c-f6a0cb744759 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Calling method '.version_select at 0x7f85ff7be820>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:22.590462 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8f87573b-a8d0-41b4-a61c-f6a0cb744759 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de" status: 202 len: 0 microversion: 2.1 time: 0.139374 Aug 17 23:43:22.591641 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 11/22] 10.222.0.26 () {58 vars in 1254 bytes} [Wed Aug 17 23:43:22 2022] DELETE /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:43:22.601864 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5b402991-f2bf-4ca6-9167-a053b0d57e43 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Calling method '.version_select at 0x7f85ff7c7430>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:22.659308 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5b402991-f2bf-4ca6-9167-a053b0d57e43 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de" status: 200 len: 287 microversion: 2.1 time: 0.063118 Aug 17 23:43:22.660258 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 12/23] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Aug 17 23:43:22 2022] GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:43:23.007591 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-2dddda6c-fa9a-4ff8-9dba-43a079260bc9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Action: 'create', calling method: .version_select at 0x7f85ff7b3b80>, body: {"keypair": {"name": "tempest-keypair-1223893707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBhImRZ7Y5MSJJdBaomlZoyJLVZ2eYVr2/Dqg2HkjHlsYowNAvWXPPOp4UGSHkUlnnJjl0gkPdDIh+kjkgm+1tO2HDbmVLCf72kT5o8DmZj7JmkkqOoRG6JoKlvIKqn8g=="}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:43:23.148679 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-2dddda6c-fa9a-4ff8-9dba-43a079260bc9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Getting quotas for project 258851d93c2d466a85150116d68441b6. Resources: {'key_pairs'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:43:23.169625 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-2dddda6c-fa9a-4ff8-9dba-43a079260bc9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Getting quotas for user 21e06d9bb5a240459ef3298a990a42f2 and project 258851d93c2d466a85150116d68441b6. Resources: {'key_pairs'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:43:23.295683 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-2dddda6c-fa9a-4ff8-9dba-43a079260bc9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.570728 Aug 17 23:43:23.296935 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 12/24] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Aug 17 23:43:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:43:23.673116 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-81dc317f-0aba-4ff9-a02a-4eef96dea830 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Calling method '.version_select at 0x7f85ff7c7af0>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:23.714597 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-81dc317f-0aba-4ff9-a02a-4eef96dea830 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] HTTP exception thrown: Snapshot 9311d7e3-8847-41ae-9187-292a70fc10de could not be found. Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-81dc317f-0aba-4ff9-a02a-4eef96dea830 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Request method failure captured: Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de HTTP/1.1 Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X0MXPHIs5ZE5fGjmwaHbvJN8UO1-esxNoskgl1cD3SYxcUd8z5Lzgyq6VtbSRFPpCewZo7818owY3NJrcbIg9D2LJ1T3WbLdrjPoCinmoGxPGJZVxmC-r6yMG9vQoYYTDAGGdu9Z21t2Z-1ENztLnClmX9f8oCUoyVV6g_J7re1dc0 Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: aaf39b11fdbc4995aecfa322126450fe Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1006473314 Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:43:23.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:43:23.718112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aaf39b11fdbc4995aecfa322126450fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aaf39b11fdbc4995aecfa322126450fe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aaf39b11fdbc4995aecfa322126450fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aaf39b11fdbc4995aecfa322126450fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:43:23.718112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1006473314 Aug 17 23:43:23.718112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: aaf39b11fdbc4995aecfa322126450fe Aug 17 23:43:23.718112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1006473314 Aug 17 23:43:23.718112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-VolumesSnapshotsTestJSON-1006473314-project Aug 17 23:43:23.718112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:43:23.718112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:43:23.718112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 140b34e8949846549815df130d6ab172 Aug 17 23:43:23.718112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1006473314-project Aug 17 23:43:23.718112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: Aug 17 23:43:23.718112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Snapshot 9311d7e3-8847-41ae-9187-292a70fc10de could not be found. Aug 17 23:43:23.718112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': '9311d7e3-8847-41ae-9187-292a70fc10de'} Aug 17 23:43:23.718112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:43:23.718909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:43:23.718909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 17 23:43:23.718909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 17 23:43:23.718909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 17 23:43:23.718909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 17 23:43:23.718909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 17 23:43:23.718909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 17 23:43:23.718909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 23:43:23.718909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 23:43:23.718909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 23:43:23.718909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 23:43:23.718909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 23:43:23.718909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 23:43:23.718909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 23:43:23.718909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 23:43:23.718909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9311d7e3-8847-41ae-9187-292a70fc10de could not be found. (HTTP 404) (Request-ID: req-bcb45a1c-cb21-44f2-a0e9-85f757930537) Aug 17 23:43:23.718909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:23.718909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:43:23.719916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:23.719916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:43:23.719916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 17 23:43:23.719916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 17 23:43:23.719916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 23:43:23.719916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 23:43:23.719916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 17 23:43:23.719916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 17 23:43:23.719916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 23:43:23.719916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 23:43:23.719916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 17 23:43:23.719916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 17 23:43:23.719916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 17 23:43:23.719916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 17 23:43:23.719916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 17 23:43:23.719916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 17 23:43:23.719916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 23:43:23.719916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 23:43:23.719916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 23:43:23.721092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 23:43:23.721092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 23:43:23.721092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 23:43:23.721092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 23:43:23.721092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 23:43:23.721092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9311d7e3-8847-41ae-9187-292a70fc10de could not be found. Aug 17 23:43:23.721092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:23.721092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:43:23.721092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:23.721092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:43:23.721092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:43:23.721092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:43:23.721092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:43:23.721092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:43:23.721092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 23:43:23.721092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 23:43:23.721092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:43:23.721092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:43:23.721092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 17 23:43:23.721092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:43:23.722195 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9311d7e3-8847-41ae-9187-292a70fc10de could not be found. Aug 17 23:43:23.722195 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:23.722195 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:43:23.722195 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:23.722195 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:43:23.722195 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:43:23.722195 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:43:23.722195 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:43:23.722195 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:43:23.722195 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9311d7e3-8847-41ae-9187-292a70fc10de could not be found. Aug 17 23:43:23.722195 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:23.723715 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-81dc317f-0aba-4ff9-a02a-4eef96dea830 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Returning 404 to user: Snapshot 9311d7e3-8847-41ae-9187-292a70fc10de could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:43:23.724749 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-81dc317f-0aba-4ff9-a02a-4eef96dea830 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de" status: 404 len: 111 microversion: 2.1 time: 0.055703 Aug 17 23:43:23.725457 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 13/25] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Aug 17 23:43:23 2022] GET /compute/v2.1/os-snapshots/9311d7e3-8847-41ae-9187-292a70fc10de => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:43:23.738436 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1774eeb1-51ea-4744-b647-a370b2507fb8 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Calling method '.version_select at 0x7f85ff721820>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:23.954482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1774eeb1-51ea-4744-b647-a370b2507fb8 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b" status: 202 len: 0 microversion: 2.1 time: 0.222351 Aug 17 23:43:23.957613 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 13/26] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Aug 17 23:43:23 2022] DELETE /compute/v2.1/os-volumes/72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:43:23.965684 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a88b2641-aa9c-415a-be4c-8a2bc271d974 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Calling method '.version_select at 0x7f85ff7c6af0>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:24.128248 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a88b2641-aa9c-415a-be4c-8a2bc271d974 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b" status: 200 len: 344 microversion: 2.1 time: 0.166723 Aug 17 23:43:24.128824 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 14/27] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 17 23:43:23 2022] GET /compute/v2.1/os-volumes/72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b => generated 344 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:43:25.143937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d5602b02-e791-404e-890f-3811d7838055 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Calling method '.version_select at 0x7f85ff7be790>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:25.195996 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-d5602b02-e791-404e-890f-3811d7838055 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] HTTP exception thrown: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d5602b02-e791-404e-890f-3811d7838055 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Request method failure captured: Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: GET /compute/v2.1/os-volumes/72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b HTTP/1.1 Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X0MXPHIs5ZE5fGjmwaHbvJN8UO1-esxNoskgl1cD3SYxcUd8z5Lzgyq6VtbSRFPpCewZo7818owY3NJrcbIg9D2LJ1T3WbLdrjPoCinmoGxPGJZVxmC-r6yMG9vQoYYTDAGGdu9Z21t2Z-1ENztLnClmX9f8oCUoyVV6g_J7re1dc0 Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: aaf39b11fdbc4995aecfa322126450fe Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1006473314 Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:43:25.207024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:43:25.208181 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aaf39b11fdbc4995aecfa322126450fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aaf39b11fdbc4995aecfa322126450fe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aaf39b11fdbc4995aecfa322126450fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aaf39b11fdbc4995aecfa322126450fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:43:25.208181 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1006473314 Aug 17 23:43:25.208181 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: aaf39b11fdbc4995aecfa322126450fe Aug 17 23:43:25.208181 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1006473314 Aug 17 23:43:25.208181 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-VolumesSnapshotsTestJSON-1006473314-project Aug 17 23:43:25.208181 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:43:25.208181 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:43:25.208181 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 140b34e8949846549815df130d6ab172 Aug 17 23:43:25.208181 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1006473314-project Aug 17 23:43:25.208181 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: Aug 17 23:43:25.208181 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. Aug 17 23:43:25.208181 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': '72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b'} Aug 17 23:43:25.208181 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:43:25.208807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:43:25.208807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 23:43:25.208807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 23:43:25.208807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 23:43:25.208807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 23:43:25.208807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 23:43:25.208807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 23:43:25.208807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 23:43:25.208807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 23:43:25.208807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 23:43:25.208807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 23:43:25.208807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 23:43:25.208807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 23:43:25.208807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 23:43:25.208807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 23:43:25.208807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. (HTTP 404) (Request-ID: req-d7c2275f-7993-4a39-9694-d8ca3a5ce0ef) Aug 17 23:43:25.208807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.208807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:43:25.208807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.209686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:43:25.209686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 23:43:25.209686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 23:43:25.209686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 23:43:25.209686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 23:43:25.209686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 23:43:25.209686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 23:43:25.209686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 23:43:25.209686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 23:43:25.209686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 23:43:25.209686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 23:43:25.209686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 23:43:25.209686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 23:43:25.209686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 23:43:25.209686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 23:43:25.209686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 23:43:25.209686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 23:43:25.209686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 23:43:25.209686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 23:43:25.210544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 23:43:25.210544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 23:43:25.210544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 23:43:25.210544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 23:43:25.210544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. Aug 17 23:43:25.210544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.210544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:43:25.210544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.210544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:43:25.210544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:43:25.210544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:43:25.210544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:43:25.210544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:43:25.210544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 23:43:25.210544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 23:43:25.210544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:43:25.210544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:43:25.210544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 23:43:25.210544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:43:25.211440 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. Aug 17 23:43:25.211440 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.211440 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:43:25.211440 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.211440 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:43:25.211440 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:43:25.211440 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:43:25.211440 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:43:25.211440 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:43:25.211440 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. Aug 17 23:43:25.211440 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.211440 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d5602b02-e791-404e-890f-3811d7838055 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Returning 404 to user: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:43:25.214917 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d5602b02-e791-404e-890f-3811d7838055 tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b" status: 404 len: 109 microversion: 2.1 time: 0.075319 Aug 17 23:43:25.215988 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 14/28] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 17 23:43:25 2022] GET /compute/v2.1/os-volumes/72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:43:25.235175 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ef30d26a-86da-4130-8fec-3d03eddf652e tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Calling method '.version_select at 0x7f85ff7c1670>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:25.296042 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-ef30d26a-86da-4130-8fec-3d03eddf652e tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] HTTP exception thrown: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ef30d26a-86da-4130-8fec-3d03eddf652e tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Request method failure captured: Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: DELETE /compute/v2.1/os-volumes/72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b HTTP/1.1 Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X0MXPHIs5ZE5fGjmwaHbvJN8UO1-esxNoskgl1cD3SYxcUd8z5Lzgyq6VtbSRFPpCewZo7818owY3NJrcbIg9D2LJ1T3WbLdrjPoCinmoGxPGJZVxmC-r6yMG9vQoYYTDAGGdu9Z21t2Z-1ENztLnClmX9f8oCUoyVV6g_J7re1dc0 Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: aaf39b11fdbc4995aecfa322126450fe Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1006473314 Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:43:25.298937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:43:25.300076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aaf39b11fdbc4995aecfa322126450fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aaf39b11fdbc4995aecfa322126450fe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aaf39b11fdbc4995aecfa322126450fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aaf39b11fdbc4995aecfa322126450fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:43:25.300076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1006473314 Aug 17 23:43:25.300076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: aaf39b11fdbc4995aecfa322126450fe Aug 17 23:43:25.300076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1006473314 Aug 17 23:43:25.300076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-VolumesSnapshotsTestJSON-1006473314-project Aug 17 23:43:25.300076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:43:25.300076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:43:25.300076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 140b34e8949846549815df130d6ab172 Aug 17 23:43:25.300076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1006473314-project Aug 17 23:43:25.300076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: Aug 17 23:43:25.300076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. Aug 17 23:43:25.300076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': '72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b'} Aug 17 23:43:25.300076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:43:25.300694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:43:25.300694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 23:43:25.300694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 23:43:25.300694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 23:43:25.300694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 23:43:25.300694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 23:43:25.300694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 23:43:25.300694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 23:43:25.300694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 23:43:25.300694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 23:43:25.300694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 23:43:25.300694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 23:43:25.300694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 23:43:25.300694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 23:43:25.300694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 23:43:25.300694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. (HTTP 404) (Request-ID: req-6af815bb-df53-4351-ab7d-b156f828dcd8) Aug 17 23:43:25.300694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.300694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:43:25.300694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.301551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:43:25.301551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 23:43:25.301551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 23:43:25.301551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 23:43:25.301551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 23:43:25.301551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 23:43:25.301551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 23:43:25.301551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 23:43:25.301551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 23:43:25.301551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 23:43:25.301551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 23:43:25.301551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 23:43:25.301551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 23:43:25.301551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 23:43:25.301551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 23:43:25.301551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 23:43:25.301551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 23:43:25.301551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 23:43:25.301551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 23:43:25.302406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 23:43:25.302406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 23:43:25.302406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 23:43:25.302406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 23:43:25.302406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. Aug 17 23:43:25.302406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.302406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:43:25.302406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.302406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:43:25.302406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:43:25.302406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:43:25.302406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:43:25.302406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:43:25.302406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 23:43:25.302406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 23:43:25.302406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:43:25.302406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:43:25.302406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 23:43:25.302406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:43:25.303274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. Aug 17 23:43:25.303274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.303274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:43:25.303274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.303274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:43:25.303274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:43:25.303274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:43:25.303274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:43:25.303274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:43:25.303274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. Aug 17 23:43:25.303274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.303274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ef30d26a-86da-4130-8fec-3d03eddf652e tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Returning 404 to user: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:43:25.303274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ef30d26a-86da-4130-8fec-3d03eddf652e tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b" status: 404 len: 109 microversion: 2.1 time: 0.072062 Aug 17 23:43:25.308123 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 15/29] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Aug 17 23:43:25 2022] DELETE /compute/v2.1/os-volumes/72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:43:25.312988 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-24c8b2ab-0746-457c-bac9-05aa5452869b tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Calling method '.version_select at 0x7f8600191820>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:25.390837 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-24c8b2ab-0746-457c-bac9-05aa5452869b tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] HTTP exception thrown: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-24c8b2ab-0746-457c-bac9-05aa5452869b tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Request method failure captured: Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: GET /compute/v2.1/os-volumes/72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b HTTP/1.1 Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X0MXPHIs5ZE5fGjmwaHbvJN8UO1-esxNoskgl1cD3SYxcUd8z5Lzgyq6VtbSRFPpCewZo7818owY3NJrcbIg9D2LJ1T3WbLdrjPoCinmoGxPGJZVxmC-r6yMG9vQoYYTDAGGdu9Z21t2Z-1ENztLnClmX9f8oCUoyVV6g_J7re1dc0 Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: aaf39b11fdbc4995aecfa322126450fe Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1006473314 Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:43:25.394115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:43:25.395150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aaf39b11fdbc4995aecfa322126450fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aaf39b11fdbc4995aecfa322126450fe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aaf39b11fdbc4995aecfa322126450fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aaf39b11fdbc4995aecfa322126450fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:43:25.395150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1006473314 Aug 17 23:43:25.395150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: aaf39b11fdbc4995aecfa322126450fe Aug 17 23:43:25.395150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1006473314 Aug 17 23:43:25.395150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-VolumesSnapshotsTestJSON-1006473314-project Aug 17 23:43:25.395150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:43:25.395150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:43:25.395150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 140b34e8949846549815df130d6ab172 Aug 17 23:43:25.395150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1006473314-project Aug 17 23:43:25.395150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: Aug 17 23:43:25.395150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. Aug 17 23:43:25.395150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': '72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b'} Aug 17 23:43:25.395150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:43:25.395758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:43:25.395758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 23:43:25.395758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 23:43:25.395758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 23:43:25.395758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 23:43:25.395758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 23:43:25.395758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 23:43:25.395758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 23:43:25.395758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 23:43:25.395758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 23:43:25.395758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 23:43:25.395758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 23:43:25.395758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 23:43:25.395758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 23:43:25.395758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 23:43:25.395758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. (HTTP 404) (Request-ID: req-aeafa9e6-642a-4898-80e5-336eed563e6d) Aug 17 23:43:25.395758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.395758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:43:25.395758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.396670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:43:25.396670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 23:43:25.396670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 23:43:25.396670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 23:43:25.396670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 23:43:25.396670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 23:43:25.396670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 23:43:25.396670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 23:43:25.396670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 23:43:25.396670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 23:43:25.396670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 23:43:25.396670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 23:43:25.396670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 23:43:25.396670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 23:43:25.396670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 23:43:25.396670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 23:43:25.396670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 23:43:25.396670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 23:43:25.396670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 23:43:25.398269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 23:43:25.398269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 23:43:25.398269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 23:43:25.398269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 23:43:25.398269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. Aug 17 23:43:25.398269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.398269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:43:25.398269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.398269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:43:25.398269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:43:25.398269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:43:25.398269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:43:25.398269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:43:25.398269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 23:43:25.398269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 23:43:25.398269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:43:25.398269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:43:25.398269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 23:43:25.398269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:43:25.399494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. Aug 17 23:43:25.399494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.399494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:43:25.399494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.399494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:43:25.399494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:43:25.399494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:43:25.399494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:43:25.399494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:43:25.399494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. Aug 17 23:43:25.399494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:43:25.399494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-24c8b2ab-0746-457c-bac9-05aa5452869b tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] Returning 404 to user: Volume 72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:43:25.399494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-24c8b2ab-0746-457c-bac9-05aa5452869b tempest-VolumesSnapshotsTestJSON-1006473314 tempest-VolumesSnapshotsTestJSON-1006473314-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b" status: 404 len: 109 microversion: 2.1 time: 0.089034 Aug 17 23:43:25.405254 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 15/30] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 17 23:43:25 2022] GET /compute/v2.1/os-volumes/72cd8bc0-a2dd-49cf-bd5a-8945c9d1a10b => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:43:26.277518 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-320425f1-07f0-4513-8005-c967f21e4547 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1674581765", "imageRef": "a3cf81e5-e973-4c08-b1da-4e8f104b52a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:43:26.534413 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.network.neutron [None req-320425f1-07f0-4513-8005-c967f21e4547 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] validate_networks() for [('118a36b6-d40e-41df-9c07-5e59fcb025b9', None, None, None, None, None)] {{(pid=131395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:43:28.714047 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-320425f1-07f0-4513-8005-c967f21e4547 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Flavor limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:43:28.715323 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-320425f1-07f0-4513-8005-c967f21e4547 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Image limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:43:28.716225 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-320425f1-07f0-4513-8005-c967f21e4547 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Flavor pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:43:28.716844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-320425f1-07f0-4513-8005-c967f21e4547 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Image pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:43:28.717491 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-320425f1-07f0-4513-8005-c967f21e4547 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:43:28.757539 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-320425f1-07f0-4513-8005-c967f21e4547 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:28.757980 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-320425f1-07f0-4513-8005-c967f21e4547 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:28.758428 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-320425f1-07f0-4513-8005-c967f21e4547 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:28.759205 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-320425f1-07f0-4513-8005-c967f21e4547 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:28.759702 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-320425f1-07f0-4513-8005-c967f21e4547 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:28.760165 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-320425f1-07f0-4513-8005-c967f21e4547 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:28.851326 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-320425f1-07f0-4513-8005-c967f21e4547 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Getting quotas for project dbc0fe79b67f4446b1a4c36c068f9b00. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:43:28.882404 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-320425f1-07f0-4513-8005-c967f21e4547 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Getting quotas for user c67dec924b7e4f0aa0874e6e21879889 and project dbc0fe79b67f4446b1a4c36c068f9b00. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:43:28.914209 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-320425f1-07f0-4513-8005-c967f21e4547 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Going to run 1 instances... {{(pid=131395) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:43:28.922794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-320425f1-07f0-4513-8005-c967f21e4547 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a3cf81e5-e973-4c08-b1da-4e8f104b52a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:43:29.091174 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-320425f1-07f0-4513-8005-c967f21e4547 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.184648 Aug 17 23:43:29.092637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 16/31] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 17 23:43:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 3187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 23:43:29.110660 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-4953d77a-37c2-446a-9a6d-19f48871493c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:29.111284 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-4953d77a-37c2-446a-9a6d-19f48871493c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:29.168775 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1495d78a-2fdd-421f-b49d-3c65a4f4e224 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Action: 'create', calling method: .version_select at 0x7f85feeb1310>, body: {"keypair": {"name": "tempest-keypair-298744942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5svxzeGgSeZl8nZBsCTmBzHYXU7rHZLmjx3IN743lqCbwricNiEaa3jgprtdGEwOqFq3ZyjNVfvfaOij3ppPchEYIuXs2cv+qQwu0C6JZtvHJ/MVClF5J/Lkuml1sr5Q=="}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:43:29.210502 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-1495d78a-2fdd-421f-b49d-3c65a4f4e224 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Getting quotas for project d9574c6bc0ea4f78a0145fc2764a6fa9. Resources: {'key_pairs'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:43:29.226565 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-1495d78a-2fdd-421f-b49d-3c65a4f4e224 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Getting quotas for user 2da686247e7f490ab7924d0456da60d5 and project d9574c6bc0ea4f78a0145fc2764a6fa9. Resources: {'key_pairs'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:43:29.283526 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1495d78a-2fdd-421f-b49d-3c65a4f4e224 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.455312 Aug 17 23:43:29.284164 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 16/32] 10.222.0.26 () {62 vars in 1200 bytes} [Wed Aug 17 23:43:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 457 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 17 23:43:29.419099 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-4953d77a-37c2-446a-9a6d-19f48871493c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:29.456428 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-4953d77a-37c2-446a-9a6d-19f48871493c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1222 microversion: 2.1 time: 0.350639 Aug 17 23:43:29.459129 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 17/33] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:29 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1222 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:30.058968 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-dae61cfb-c454-4d73-80ef-aa1780df54e6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1494484242", "imageRef": "a3cf81e5-e973-4c08-b1da-4e8f104b52a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:43:30.078815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c8ce25a5-6619-413d-bf2e-6ef3fc8b5eb6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1479444424", "imageRef": "a3cf81e5-e973-4c08-b1da-4e8f104b52a1", "flavorRef": "452", "networks": [{"uuid": "f00d49ef-c673-47c6-a2f2-3333845e82d0"}]}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:43:30.181368 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.network.neutron [None req-dae61cfb-c454-4d73-80ef-aa1780df54e6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] validate_networks() for [('118a36b6-d40e-41df-9c07-5e59fcb025b9', None, None, None, None, None)] {{(pid=131395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:43:30.234818 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.network.neutron [None req-c8ce25a5-6619-413d-bf2e-6ef3fc8b5eb6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] validate_networks() for [('f00d49ef-c673-47c6-a2f2-3333845e82d0', None, None, None, None, None)] {{(pid=131394) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:43:31.005961 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-dae61cfb-c454-4d73-80ef-aa1780df54e6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Flavor limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:43:31.006707 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-dae61cfb-c454-4d73-80ef-aa1780df54e6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Image limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:43:31.007323 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-dae61cfb-c454-4d73-80ef-aa1780df54e6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Flavor pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:43:31.008039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-dae61cfb-c454-4d73-80ef-aa1780df54e6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Image pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:43:31.008754 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-dae61cfb-c454-4d73-80ef-aa1780df54e6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:43:31.028260 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dae61cfb-c454-4d73-80ef-aa1780df54e6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:31.030367 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dae61cfb-c454-4d73-80ef-aa1780df54e6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:31.030367 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dae61cfb-c454-4d73-80ef-aa1780df54e6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:31.031122 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dae61cfb-c454-4d73-80ef-aa1780df54e6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:31.033453 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dae61cfb-c454-4d73-80ef-aa1780df54e6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:31.034933 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dae61cfb-c454-4d73-80ef-aa1780df54e6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:31.098381 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-dae61cfb-c454-4d73-80ef-aa1780df54e6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Getting quotas for project dbc0fe79b67f4446b1a4c36c068f9b00. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:43:31.104233 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-dae61cfb-c454-4d73-80ef-aa1780df54e6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Getting quotas for user c67dec924b7e4f0aa0874e6e21879889 and project dbc0fe79b67f4446b1a4c36c068f9b00. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:43:31.118891 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-dae61cfb-c454-4d73-80ef-aa1780df54e6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Going to run 1 instances... {{(pid=131395) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:43:31.121986 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-dae61cfb-c454-4d73-80ef-aa1780df54e6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a3cf81e5-e973-4c08-b1da-4e8f104b52a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:43:31.183577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-dae61cfb-c454-4d73-80ef-aa1780df54e6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.129966 Aug 17 23:43:31.190158 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 18/34] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 17 23:43:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 23:43:31.196550 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-35244e89-41ba-410d-83b3-6e29cb7cf072 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1456447356", "imageRef": "a3cf81e5-e973-4c08-b1da-4e8f104b52a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1116845-6414-4feb-bcc7-64852b6be391"}], "security_groups": [{"name": "tempest-securitygroup--1632269427"}], "key_name": "tempest-keypair-1223893707", "user_data": "}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:43:31.465680 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.network.neutron [None req-35244e89-41ba-410d-83b3-6e29cb7cf072 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] validate_networks() for [('d1116845-6414-4feb-bcc7-64852b6be391', None, None, None, None, None)] {{(pid=131395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:43:32.841500 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-35244e89-41ba-410d-83b3-6e29cb7cf072 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Flavor limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:43:32.843576 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-35244e89-41ba-410d-83b3-6e29cb7cf072 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Image limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:43:32.844288 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-35244e89-41ba-410d-83b3-6e29cb7cf072 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Flavor pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:43:32.846488 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-35244e89-41ba-410d-83b3-6e29cb7cf072 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Image pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:43:32.847449 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-35244e89-41ba-410d-83b3-6e29cb7cf072 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:43:32.869390 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-35244e89-41ba-410d-83b3-6e29cb7cf072 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:32.870715 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-35244e89-41ba-410d-83b3-6e29cb7cf072 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:32.871361 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-35244e89-41ba-410d-83b3-6e29cb7cf072 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:32.874711 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-35244e89-41ba-410d-83b3-6e29cb7cf072 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:32.875660 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-35244e89-41ba-410d-83b3-6e29cb7cf072 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:32.876355 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-35244e89-41ba-410d-83b3-6e29cb7cf072 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:32.974049 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-35244e89-41ba-410d-83b3-6e29cb7cf072 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Getting quotas for project 258851d93c2d466a85150116d68441b6. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:43:32.991524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-35244e89-41ba-410d-83b3-6e29cb7cf072 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Getting quotas for user 21e06d9bb5a240459ef3298a990a42f2 and project 258851d93c2d466a85150116d68441b6. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:43:33.049042 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-35244e89-41ba-410d-83b3-6e29cb7cf072 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Going to run 1 instances... {{(pid=131395) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:43:33.053355 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-35244e89-41ba-410d-83b3-6e29cb7cf072 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a3cf81e5-e973-4c08-b1da-4e8f104b52a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:43:33.247550 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-35244e89-41ba-410d-83b3-6e29cb7cf072 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.056148 Aug 17 23:43:33.248301 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 19/35] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 17 23:43:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 2058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 23:43:33.258688 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-44169fe1-a396-4405-bfbe-20f5ec1c9bec tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:33.273003 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-44169fe1-a396-4405-bfbe-20f5ec1c9bec tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:33.400747 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-44169fe1-a396-4405-bfbe-20f5ec1c9bec tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:33.412459 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-44169fe1-a396-4405-bfbe-20f5ec1c9bec tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1222 microversion: 2.1 time: 0.160530 Aug 17 23:43:33.413739 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 20/36] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:33 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1222 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:33.420945 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b764b277-2aa9-4e76-a520-9a8d17db1263 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:33.421860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b764b277-2aa9-4e76-a520-9a8d17db1263 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:33.580399 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b764b277-2aa9-4e76-a520-9a8d17db1263 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:33.588716 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b764b277-2aa9-4e76-a520-9a8d17db1263 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1242 microversion: 2.1 time: 0.173561 Aug 17 23:43:33.589115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-c8ce25a5-6619-413d-bf2e-6ef3fc8b5eb6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Flavor limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:43:33.589594 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-c8ce25a5-6619-413d-bf2e-6ef3fc8b5eb6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Image limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:43:33.590020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-c8ce25a5-6619-413d-bf2e-6ef3fc8b5eb6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Flavor pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:43:33.591317 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-c8ce25a5-6619-413d-bf2e-6ef3fc8b5eb6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Image pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:43:33.591756 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-c8ce25a5-6619-413d-bf2e-6ef3fc8b5eb6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:43:33.596291 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 21/37] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:33 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1242 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:33.636095 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c8ce25a5-6619-413d-bf2e-6ef3fc8b5eb6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:33.637025 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c8ce25a5-6619-413d-bf2e-6ef3fc8b5eb6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:33.640477 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c8ce25a5-6619-413d-bf2e-6ef3fc8b5eb6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:33.651025 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c8ce25a5-6619-413d-bf2e-6ef3fc8b5eb6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:33.651950 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c8ce25a5-6619-413d-bf2e-6ef3fc8b5eb6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:33.654832 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c8ce25a5-6619-413d-bf2e-6ef3fc8b5eb6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:33.734496 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-c8ce25a5-6619-413d-bf2e-6ef3fc8b5eb6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Getting quotas for project b7ebf323aa7c4874bd7d0e2f2873b591. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:43:33.747898 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-c8ce25a5-6619-413d-bf2e-6ef3fc8b5eb6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Getting quotas for user 7c852a7d720347be87d8205716dfc15f and project b7ebf323aa7c4874bd7d0e2f2873b591. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:43:33.790852 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c8ce25a5-6619-413d-bf2e-6ef3fc8b5eb6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Going to run 1 instances... {{(pid=131394) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:43:33.797057 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c8ce25a5-6619-413d-bf2e-6ef3fc8b5eb6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a3cf81e5-e973-4c08-b1da-4e8f104b52a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131394) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:43:33.969091 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c8ce25a5-6619-413d-bf2e-6ef3fc8b5eb6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.508275 Aug 17 23:43:33.969750 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 17/38] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 17 23:43:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 4510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 23:43:33.984959 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-976344ac-38e0-454b-8181-48f6758b6669 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:33.985700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-976344ac-38e0-454b-8181-48f6758b6669 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:34.157349 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-976344ac-38e0-454b-8181-48f6758b6669 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:34.183382 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-976344ac-38e0-454b-8181-48f6758b6669 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1215 microversion: 2.1 time: 0.198290 Aug 17 23:43:34.185810 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 22/39] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:33 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1215 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:34.436951 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-67c57dde-eb15-4874-b113-5402a65a5f0c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:34.437645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-67c57dde-eb15-4874-b113-5402a65a5f0c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:34.493681 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-67c57dde-eb15-4874-b113-5402a65a5f0c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:34.494218 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-67c57dde-eb15-4874-b113-5402a65a5f0c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:34.494664 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-67c57dde-eb15-4874-b113-5402a65a5f0c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:34.495400 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-67c57dde-eb15-4874-b113-5402a65a5f0c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:34.495862 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-67c57dde-eb15-4874-b113-5402a65a5f0c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:34.496335 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-67c57dde-eb15-4874-b113-5402a65a5f0c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:34.623702 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-90ec60ab-c7ec-4c0b-9430-2dd133d982c1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:34.625273 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-90ec60ab-c7ec-4c0b-9430-2dd133d982c1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:34.654630 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90ec60ab-c7ec-4c0b-9430-2dd133d982c1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:34.655344 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90ec60ab-c7ec-4c0b-9430-2dd133d982c1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:34.655933 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90ec60ab-c7ec-4c0b-9430-2dd133d982c1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:34.658925 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90ec60ab-c7ec-4c0b-9430-2dd133d982c1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:34.662247 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90ec60ab-c7ec-4c0b-9430-2dd133d982c1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:34.666179 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90ec60ab-c7ec-4c0b-9430-2dd133d982c1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:35.041826 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-67c57dde-eb15-4874-b113-5402a65a5f0c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:35.059668 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-90ec60ab-c7ec-4c0b-9430-2dd133d982c1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:35.094637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-90ec60ab-c7ec-4c0b-9430-2dd133d982c1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1238 microversion: 2.1 time: 0.475498 Aug 17 23:43:35.096933 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 23/40] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:34 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1238 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:43:35.106102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-acc47749-c0d8-42df-af1f-dd582bb961d0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1275882594", "imageRef": "a3cf81e5-e973-4c08-b1da-4e8f104b52a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed727300-4b01-4f41-a5fa-506d64f178aa"}], "security_groups": [{"name": "tempest-securitygroup--1510352246"}], "key_name": "tempest-keypair-298744942", "user_data": "}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:43:35.133167 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-67c57dde-eb15-4874-b113-5402a65a5f0c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1274 microversion: 2.1 time: 0.701972 Aug 17 23:43:35.133901 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 18/41] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:34 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1274 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:35.209702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ee3b26de-57d2-4592-b49b-cd56672503fc tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:35.210311 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ee3b26de-57d2-4592-b49b-cd56672503fc tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:35.230487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ee3b26de-57d2-4592-b49b-cd56672503fc tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:35.244439 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ee3b26de-57d2-4592-b49b-cd56672503fc tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:35.246645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ee3b26de-57d2-4592-b49b-cd56672503fc tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:35.249378 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ee3b26de-57d2-4592-b49b-cd56672503fc tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:35.251905 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ee3b26de-57d2-4592-b49b-cd56672503fc tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:35.258153 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ee3b26de-57d2-4592-b49b-cd56672503fc tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:35.451824 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.network.neutron [None req-acc47749-c0d8-42df-af1f-dd582bb961d0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] validate_networks() for [('ed727300-4b01-4f41-a5fa-506d64f178aa', None, None, None, None, None)] {{(pid=131395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:43:35.795307 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ee3b26de-57d2-4592-b49b-cd56672503fc tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:35.804707 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ee3b26de-57d2-4592-b49b-cd56672503fc tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1219 microversion: 2.1 time: 0.598811 Aug 17 23:43:35.812504 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 19/42] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:35 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1219 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:36.121050 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9f0cd826-40a8-440b-927c-afee739ab9e7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:36.123300 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9f0cd826-40a8-440b-927c-afee739ab9e7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:36.139134 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f0cd826-40a8-440b-927c-afee739ab9e7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:36.139890 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f0cd826-40a8-440b-927c-afee739ab9e7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:36.141046 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f0cd826-40a8-440b-927c-afee739ab9e7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:36.143044 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f0cd826-40a8-440b-927c-afee739ab9e7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:36.144908 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f0cd826-40a8-440b-927c-afee739ab9e7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:36.146066 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f0cd826-40a8-440b-927c-afee739ab9e7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:36.640985 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9f0cd826-40a8-440b-927c-afee739ab9e7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:36.649206 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9f0cd826-40a8-440b-927c-afee739ab9e7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1294 microversion: 2.1 time: 0.531925 Aug 17 23:43:36.652332 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 20/43] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:36 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1294 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:43:36.661001 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8b5226ab-7350-4066-92b5-395392204b40 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:36.664772 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8b5226ab-7350-4066-92b5-395392204b40 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:36.679590 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8b5226ab-7350-4066-92b5-395392204b40 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:36.682716 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8b5226ab-7350-4066-92b5-395392204b40 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:36.683546 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8b5226ab-7350-4066-92b5-395392204b40 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:36.684720 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8b5226ab-7350-4066-92b5-395392204b40 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:36.685372 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8b5226ab-7350-4066-92b5-395392204b40 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:36.687842 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8b5226ab-7350-4066-92b5-395392204b40 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:37.211898 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-8b5226ab-7350-4066-92b5-395392204b40 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:37.226462 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8b5226ab-7350-4066-92b5-395392204b40 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1280 microversion: 2.1 time: 0.566453 Aug 17 23:43:37.229141 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 21/44] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:36 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1280 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:37.246024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-2b63b71f-a853-434b-babd-e863e17123ae tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:37.248993 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-2b63b71f-a853-434b-babd-e863e17123ae tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:37.264142 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2b63b71f-a853-434b-babd-e863e17123ae tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:37.264815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2b63b71f-a853-434b-babd-e863e17123ae tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:37.270790 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2b63b71f-a853-434b-babd-e863e17123ae tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:37.271774 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2b63b71f-a853-434b-babd-e863e17123ae tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:37.272473 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2b63b71f-a853-434b-babd-e863e17123ae tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:37.273308 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2b63b71f-a853-434b-babd-e863e17123ae tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:37.459782 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-2b63b71f-a853-434b-babd-e863e17123ae tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:37.474637 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-2b63b71f-a853-434b-babd-e863e17123ae tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1285 microversion: 2.1 time: 0.241035 Aug 17 23:43:37.476688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 22/45] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:37 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1285 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:37.676243 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a14ca00a-9533-4cc0-8c7b-f51cade1ab26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:37.677103 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a14ca00a-9533-4cc0-8c7b-f51cade1ab26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:37.689584 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a14ca00a-9533-4cc0-8c7b-f51cade1ab26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:37.697033 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a14ca00a-9533-4cc0-8c7b-f51cade1ab26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:37.699358 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a14ca00a-9533-4cc0-8c7b-f51cade1ab26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:37.703713 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a14ca00a-9533-4cc0-8c7b-f51cade1ab26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:37.707240 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a14ca00a-9533-4cc0-8c7b-f51cade1ab26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:37.707840 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a14ca00a-9533-4cc0-8c7b-f51cade1ab26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:38.102872 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a14ca00a-9533-4cc0-8c7b-f51cade1ab26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:38.125022 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a14ca00a-9533-4cc0-8c7b-f51cade1ab26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1300 microversion: 2.1 time: 0.448664 Aug 17 23:43:38.126754 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-acc47749-c0d8-42df-af1f-dd582bb961d0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Flavor limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:43:38.137021 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-acc47749-c0d8-42df-af1f-dd582bb961d0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Image limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:43:38.137021 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-acc47749-c0d8-42df-af1f-dd582bb961d0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Flavor pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:43:38.137021 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-acc47749-c0d8-42df-af1f-dd582bb961d0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Image pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:43:38.137021 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-acc47749-c0d8-42df-af1f-dd582bb961d0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:43:38.138014 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 23/46] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:37 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1300 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:43:38.169485 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-acc47749-c0d8-42df-af1f-dd582bb961d0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:38.175212 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-acc47749-c0d8-42df-af1f-dd582bb961d0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:38.178338 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-acc47749-c0d8-42df-af1f-dd582bb961d0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:38.186572 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-acc47749-c0d8-42df-af1f-dd582bb961d0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:38.188429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-acc47749-c0d8-42df-af1f-dd582bb961d0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:38.193920 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-acc47749-c0d8-42df-af1f-dd582bb961d0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:38.261862 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-acc47749-c0d8-42df-af1f-dd582bb961d0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Getting quotas for project d9574c6bc0ea4f78a0145fc2764a6fa9. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:43:38.262258 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1c0e1203-92b0-4826-bee6-d056ab8e6469 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:38.264611 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1c0e1203-92b0-4826-bee6-d056ab8e6469 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:38.277809 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-acc47749-c0d8-42df-af1f-dd582bb961d0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Getting quotas for user 2da686247e7f490ab7924d0456da60d5 and project d9574c6bc0ea4f78a0145fc2764a6fa9. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:43:38.283857 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1c0e1203-92b0-4826-bee6-d056ab8e6469 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:38.285444 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1c0e1203-92b0-4826-bee6-d056ab8e6469 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:38.287807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1c0e1203-92b0-4826-bee6-d056ab8e6469 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:38.288776 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1c0e1203-92b0-4826-bee6-d056ab8e6469 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:38.292175 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1c0e1203-92b0-4826-bee6-d056ab8e6469 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:38.294137 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1c0e1203-92b0-4826-bee6-d056ab8e6469 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:38.307251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-acc47749-c0d8-42df-af1f-dd582bb961d0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Going to run 1 instances... {{(pid=131395) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:43:38.313749 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-acc47749-c0d8-42df-af1f-dd582bb961d0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a3cf81e5-e973-4c08-b1da-4e8f104b52a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:43:38.449888 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-acc47749-c0d8-42df-af1f-dd582bb961d0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.349657 Aug 17 23:43:38.457581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 24/47] 10.222.0.26 () {62 vars in 1188 bytes} [Wed Aug 17 23:43:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 3358 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 17 23:43:38.475694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0e6c5485-c386-48c1-bbc0-a8c441510530 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:38.477761 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0e6c5485-c386-48c1-bbc0-a8c441510530 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:38.699446 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0e6c5485-c386-48c1-bbc0-a8c441510530 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:38.709134 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0e6c5485-c386-48c1-bbc0-a8c441510530 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:38.717539 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0e6c5485-c386-48c1-bbc0-a8c441510530 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:38.724752 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0e6c5485-c386-48c1-bbc0-a8c441510530 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1281 microversion: 2.20 time: 0.262161 Aug 17 23:43:38.736513 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 25/48] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:43:38 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1281 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:43:38.761443 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-33e2ef1f-b984-4a13-8911-8d187a415515 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:38.771991 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-33e2ef1f-b984-4a13-8911-8d187a415515 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:38.803520 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-33e2ef1f-b984-4a13-8911-8d187a415515 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:38.804080 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-33e2ef1f-b984-4a13-8911-8d187a415515 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:38.804503 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-33e2ef1f-b984-4a13-8911-8d187a415515 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:38.805217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-33e2ef1f-b984-4a13-8911-8d187a415515 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:38.805675 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-33e2ef1f-b984-4a13-8911-8d187a415515 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:38.827370 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-33e2ef1f-b984-4a13-8911-8d187a415515 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:38.879230 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1c0e1203-92b0-4826-bee6-d056ab8e6469 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:38.890265 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1c0e1203-92b0-4826-bee6-d056ab8e6469 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1280 microversion: 2.1 time: 0.640830 Aug 17 23:43:38.906586 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 24/49] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:38 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1280 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:39.157413 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-93e8dd5a-dfb8-4cef-8e13-a0f58e74d01b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:39.158063 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-93e8dd5a-dfb8-4cef-8e13-a0f58e74d01b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:39.169459 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-93e8dd5a-dfb8-4cef-8e13-a0f58e74d01b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:39.175836 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-93e8dd5a-dfb8-4cef-8e13-a0f58e74d01b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:39.178866 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-93e8dd5a-dfb8-4cef-8e13-a0f58e74d01b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:39.179729 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-93e8dd5a-dfb8-4cef-8e13-a0f58e74d01b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:39.180353 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-93e8dd5a-dfb8-4cef-8e13-a0f58e74d01b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:39.180811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-93e8dd5a-dfb8-4cef-8e13-a0f58e74d01b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:39.562912 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-93e8dd5a-dfb8-4cef-8e13-a0f58e74d01b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:39.573848 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-93e8dd5a-dfb8-4cef-8e13-a0f58e74d01b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1300 microversion: 2.1 time: 0.420803 Aug 17 23:43:39.584343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 25/50] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:39 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1300 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:39.763380 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-79116c85-64c7-4232-876c-cf46dfb95f69 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:39.764032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-79116c85-64c7-4232-876c-cf46dfb95f69 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:39.773847 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-79116c85-64c7-4232-876c-cf46dfb95f69 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:39.774386 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-79116c85-64c7-4232-876c-cf46dfb95f69 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:39.774773 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-79116c85-64c7-4232-876c-cf46dfb95f69 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:39.775568 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-79116c85-64c7-4232-876c-cf46dfb95f69 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:39.776035 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-79116c85-64c7-4232-876c-cf46dfb95f69 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:39.776406 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-79116c85-64c7-4232-876c-cf46dfb95f69 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:39.800055 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-33e2ef1f-b984-4a13-8911-8d187a415515 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:39.811494 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-33e2ef1f-b984-4a13-8911-8d187a415515 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1273 microversion: 2.1 time: 1.070974 Aug 17 23:43:39.812910 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 26/51] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:38 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1273 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:39.911606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-86825952-b706-41ab-9bec-9c557bf1a711 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:39.912656 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-86825952-b706-41ab-9bec-9c557bf1a711 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:39.929222 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-86825952-b706-41ab-9bec-9c557bf1a711 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:39.929953 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-86825952-b706-41ab-9bec-9c557bf1a711 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:39.933083 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-86825952-b706-41ab-9bec-9c557bf1a711 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:39.934074 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-86825952-b706-41ab-9bec-9c557bf1a711 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:39.936123 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-86825952-b706-41ab-9bec-9c557bf1a711 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:39.937267 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-86825952-b706-41ab-9bec-9c557bf1a711 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:39.968652 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-79116c85-64c7-4232-876c-cf46dfb95f69 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:39.985153 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-79116c85-64c7-4232-876c-cf46dfb95f69 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:39.986775 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-79116c85-64c7-4232-876c-cf46dfb95f69 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:39.987935 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-79116c85-64c7-4232-876c-cf46dfb95f69 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1285 microversion: 2.20 time: 0.229226 Aug 17 23:43:39.988518 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 26/52] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:43:39 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:43:40.100944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-86825952-b706-41ab-9bec-9c557bf1a711 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:40.119613 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-86825952-b706-41ab-9bec-9c557bf1a711 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1280 microversion: 2.1 time: 0.212111 Aug 17 23:43:40.125220 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 27/53] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:39 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1280 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:43:40.615023 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a8f545cc-00ac-4767-a347-3440e688fab4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:40.616158 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a8f545cc-00ac-4767-a347-3440e688fab4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:40.625224 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a8f545cc-00ac-4767-a347-3440e688fab4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:40.625767 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a8f545cc-00ac-4767-a347-3440e688fab4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:40.626671 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a8f545cc-00ac-4767-a347-3440e688fab4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:40.628585 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a8f545cc-00ac-4767-a347-3440e688fab4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:40.629036 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a8f545cc-00ac-4767-a347-3440e688fab4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:40.633009 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a8f545cc-00ac-4767-a347-3440e688fab4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:40.817375 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a8f545cc-00ac-4767-a347-3440e688fab4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:40.826391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a8f545cc-00ac-4767-a347-3440e688fab4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1300 microversion: 2.1 time: 0.220989 Aug 17 23:43:40.827579 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 27/54] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:40 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1300 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:40.838222 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-6e0440a1-6524-4304-951d-9739c8433d7e tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:40.838851 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-6e0440a1-6524-4304-951d-9739c8433d7e tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:40.847945 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6e0440a1-6524-4304-951d-9739c8433d7e tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:40.851503 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6e0440a1-6524-4304-951d-9739c8433d7e tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:40.852033 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6e0440a1-6524-4304-951d-9739c8433d7e tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:40.852753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6e0440a1-6524-4304-951d-9739c8433d7e tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:40.855850 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6e0440a1-6524-4304-951d-9739c8433d7e tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:40.856410 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6e0440a1-6524-4304-951d-9739c8433d7e tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:40.949973 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-6e0440a1-6524-4304-951d-9739c8433d7e tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:40.973734 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-6e0440a1-6524-4304-951d-9739c8433d7e tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1273 microversion: 2.1 time: 0.139678 Aug 17 23:43:40.974817 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 28/55] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:40 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:41.019560 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-551cad8a-4d31-4d81-bd54-9f93acacd48b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:41.027080 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-551cad8a-4d31-4d81-bd54-9f93acacd48b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:41.033626 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-551cad8a-4d31-4d81-bd54-9f93acacd48b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:41.034408 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-551cad8a-4d31-4d81-bd54-9f93acacd48b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:41.035492 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-551cad8a-4d31-4d81-bd54-9f93acacd48b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:41.036952 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-551cad8a-4d31-4d81-bd54-9f93acacd48b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:41.037571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-551cad8a-4d31-4d81-bd54-9f93acacd48b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:41.038336 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-551cad8a-4d31-4d81-bd54-9f93acacd48b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:41.148345 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2c3368b5-dd8f-4150-b8c6-058fcdbb1963 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:41.149085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2c3368b5-dd8f-4150-b8c6-058fcdbb1963 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:41.158688 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2c3368b5-dd8f-4150-b8c6-058fcdbb1963 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:41.164657 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2c3368b5-dd8f-4150-b8c6-058fcdbb1963 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:41.169117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2c3368b5-dd8f-4150-b8c6-058fcdbb1963 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:41.169972 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2c3368b5-dd8f-4150-b8c6-058fcdbb1963 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:41.172292 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2c3368b5-dd8f-4150-b8c6-058fcdbb1963 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:41.172740 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2c3368b5-dd8f-4150-b8c6-058fcdbb1963 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:41.184449 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-551cad8a-4d31-4d81-bd54-9f93acacd48b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:41.213931 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-551cad8a-4d31-4d81-bd54-9f93acacd48b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:41.221000 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-551cad8a-4d31-4d81-bd54-9f93acacd48b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:41.225079 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-551cad8a-4d31-4d81-bd54-9f93acacd48b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1285 microversion: 2.20 time: 0.211761 Aug 17 23:43:41.226971 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 28/56] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:43:41 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1285 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:43:41.474093 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2c3368b5-dd8f-4150-b8c6-058fcdbb1963 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:41.482819 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2c3368b5-dd8f-4150-b8c6-058fcdbb1963 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.339620 Aug 17 23:43:41.483724 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 29/57] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:41 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:41.846649 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-83ef2fd9-7481-4735-9a82-cc7ac456ba36 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:41.847259 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-83ef2fd9-7481-4735-9a82-cc7ac456ba36 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:41.853811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-83ef2fd9-7481-4735-9a82-cc7ac456ba36 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:41.854332 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-83ef2fd9-7481-4735-9a82-cc7ac456ba36 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:41.854728 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-83ef2fd9-7481-4735-9a82-cc7ac456ba36 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:41.855597 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-83ef2fd9-7481-4735-9a82-cc7ac456ba36 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:41.856120 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-83ef2fd9-7481-4735-9a82-cc7ac456ba36 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:41.856503 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-83ef2fd9-7481-4735-9a82-cc7ac456ba36 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:41.996486 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c4b5c457-0cb2-4c2c-ac2a-23a48548d698 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:41.997459 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c4b5c457-0cb2-4c2c-ac2a-23a48548d698 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:42.001625 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:43:42.006276 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c4b5c457-0cb2-4c2c-ac2a-23a48548d698 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:42.008254 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c4b5c457-0cb2-4c2c-ac2a-23a48548d698 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:42.008824 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c4b5c457-0cb2-4c2c-ac2a-23a48548d698 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:42.010390 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c4b5c457-0cb2-4c2c-ac2a-23a48548d698 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:42.010960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c4b5c457-0cb2-4c2c-ac2a-23a48548d698 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:42.012057 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c4b5c457-0cb2-4c2c-ac2a-23a48548d698 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:42.032897 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-83ef2fd9-7481-4735-9a82-cc7ac456ba36 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:42.051614 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-83ef2fd9-7481-4735-9a82-cc7ac456ba36 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.208284 Aug 17 23:43:42.069174 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 29/58] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:41 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:42.173717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c4b5c457-0cb2-4c2c-ac2a-23a48548d698 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:42.184166 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c4b5c457-0cb2-4c2c-ac2a-23a48548d698 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.193047 Aug 17 23:43:42.185442 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 30/59] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:41 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:42.250218 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-62366532-ffca-4200-a060-0855e6299662 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:42.250915 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-62366532-ffca-4200-a060-0855e6299662 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:42.257493 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-62366532-ffca-4200-a060-0855e6299662 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:42.258144 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-62366532-ffca-4200-a060-0855e6299662 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:42.259762 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-62366532-ffca-4200-a060-0855e6299662 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:42.260570 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-62366532-ffca-4200-a060-0855e6299662 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:42.261105 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-62366532-ffca-4200-a060-0855e6299662 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:42.261594 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-62366532-ffca-4200-a060-0855e6299662 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:42.336628 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-62366532-ffca-4200-a060-0855e6299662 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:42.344351 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-62366532-ffca-4200-a060-0855e6299662 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:42.346400 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-62366532-ffca-4200-a060-0855e6299662 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:42.346963 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-62366532-ffca-4200-a060-0855e6299662 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1285 microversion: 2.20 time: 0.100644 Aug 17 23:43:42.354737 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 30/60] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:43:42 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:43:42.504074 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e4bca2e0-9ece-4ee0-a85a-e7971d972b2d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:42.504687 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e4bca2e0-9ece-4ee0-a85a-e7971d972b2d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:42.517537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e4bca2e0-9ece-4ee0-a85a-e7971d972b2d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:42.518041 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e4bca2e0-9ece-4ee0-a85a-e7971d972b2d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:42.518487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e4bca2e0-9ece-4ee0-a85a-e7971d972b2d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:42.529802 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e4bca2e0-9ece-4ee0-a85a-e7971d972b2d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:42.534416 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e4bca2e0-9ece-4ee0-a85a-e7971d972b2d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:42.536984 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e4bca2e0-9ece-4ee0-a85a-e7971d972b2d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:42.763558 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e4bca2e0-9ece-4ee0-a85a-e7971d972b2d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:42.774410 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e4bca2e0-9ece-4ee0-a85a-e7971d972b2d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.273677 Aug 17 23:43:42.776096 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 31/61] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:42 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:43.088789 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ca09e9e6-c7d7-415b-9a28-856c680c4c05 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:43.089860 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ca09e9e6-c7d7-415b-9a28-856c680c4c05 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:43.096266 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ca09e9e6-c7d7-415b-9a28-856c680c4c05 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:43.096751 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ca09e9e6-c7d7-415b-9a28-856c680c4c05 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:43.097183 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ca09e9e6-c7d7-415b-9a28-856c680c4c05 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:43.097987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ca09e9e6-c7d7-415b-9a28-856c680c4c05 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:43.098476 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ca09e9e6-c7d7-415b-9a28-856c680c4c05 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:43.098942 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ca09e9e6-c7d7-415b-9a28-856c680c4c05 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:43.204529 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-812c2e4c-abc8-4a70-9223-f7185fa0fa14 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:43.205211 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-812c2e4c-abc8-4a70-9223-f7185fa0fa14 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:43.211161 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-812c2e4c-abc8-4a70-9223-f7185fa0fa14 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:43.211806 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-812c2e4c-abc8-4a70-9223-f7185fa0fa14 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:43.213042 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-812c2e4c-abc8-4a70-9223-f7185fa0fa14 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:43.213877 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-812c2e4c-abc8-4a70-9223-f7185fa0fa14 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:43.214469 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-812c2e4c-abc8-4a70-9223-f7185fa0fa14 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:43.215048 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-812c2e4c-abc8-4a70-9223-f7185fa0fa14 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:43.249017 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ca09e9e6-c7d7-415b-9a28-856c680c4c05 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:43.258195 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ca09e9e6-c7d7-415b-9a28-856c680c4c05 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.173839 Aug 17 23:43:43.260018 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 31/62] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:43 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:43.377925 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-54ba71d7-b257-456d-81f8-5e722d16d89a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:43.378738 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-54ba71d7-b257-456d-81f8-5e722d16d89a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:43.391535 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-54ba71d7-b257-456d-81f8-5e722d16d89a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:43.392828 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-54ba71d7-b257-456d-81f8-5e722d16d89a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:43.393291 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-54ba71d7-b257-456d-81f8-5e722d16d89a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:43.395839 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-54ba71d7-b257-456d-81f8-5e722d16d89a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:43.398219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-54ba71d7-b257-456d-81f8-5e722d16d89a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:43.398723 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-54ba71d7-b257-456d-81f8-5e722d16d89a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:43.413245 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-812c2e4c-abc8-4a70-9223-f7185fa0fa14 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:43.425083 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-812c2e4c-abc8-4a70-9223-f7185fa0fa14 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.224724 Aug 17 23:43:43.426172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 32/63] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:43 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:43.504206 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-54ba71d7-b257-456d-81f8-5e722d16d89a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:43.513592 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-54ba71d7-b257-456d-81f8-5e722d16d89a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:43.515129 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-54ba71d7-b257-456d-81f8-5e722d16d89a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:43.516250 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-54ba71d7-b257-456d-81f8-5e722d16d89a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1285 microversion: 2.20 time: 0.147344 Aug 17 23:43:43.517201 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 32/64] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:43:43 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:43:43.803900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-8a4a6130-5f97-480d-bced-27522766585d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:43.804775 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-8a4a6130-5f97-480d-bced-27522766585d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:43.811343 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a4a6130-5f97-480d-bced-27522766585d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:43.811829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a4a6130-5f97-480d-bced-27522766585d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:43.812463 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a4a6130-5f97-480d-bced-27522766585d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:43.813161 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a4a6130-5f97-480d-bced-27522766585d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:43.813619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a4a6130-5f97-480d-bced-27522766585d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:43.814049 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a4a6130-5f97-480d-bced-27522766585d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:43.964436 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8a4a6130-5f97-480d-bced-27522766585d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:43.974152 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-8a4a6130-5f97-480d-bced-27522766585d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.174902 Aug 17 23:43:43.975127 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 33/65] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:43 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:44.285446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-828538ed-f7e9-406e-ace1-3c2570519de6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:44.286779 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-828538ed-f7e9-406e-ace1-3c2570519de6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:44.289004 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=2 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:43:44.289864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=14 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:43:44.297385 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-828538ed-f7e9-406e-ace1-3c2570519de6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:44.298146 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-828538ed-f7e9-406e-ace1-3c2570519de6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:44.298590 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-828538ed-f7e9-406e-ace1-3c2570519de6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:44.299288 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-828538ed-f7e9-406e-ace1-3c2570519de6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:44.299892 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-828538ed-f7e9-406e-ace1-3c2570519de6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:44.300495 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-828538ed-f7e9-406e-ace1-3c2570519de6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:44.451881 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-aba10933-3018-4e5b-add8-1f0a742c482a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:44.453569 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-aba10933-3018-4e5b-add8-1f0a742c482a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:44.461908 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-aba10933-3018-4e5b-add8-1f0a742c482a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:44.463261 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-aba10933-3018-4e5b-add8-1f0a742c482a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:44.464003 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-aba10933-3018-4e5b-add8-1f0a742c482a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:44.464947 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-aba10933-3018-4e5b-add8-1f0a742c482a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:44.465604 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-aba10933-3018-4e5b-add8-1f0a742c482a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:44.466141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-aba10933-3018-4e5b-add8-1f0a742c482a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:44.491758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-828538ed-f7e9-406e-ace1-3c2570519de6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:44.500704 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-828538ed-f7e9-406e-ace1-3c2570519de6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.219088 Aug 17 23:43:44.501301 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 33/66] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:44 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:44.539430 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d75c1367-a5e5-47d3-8333-d70e37d3eab0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:44.540388 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d75c1367-a5e5-47d3-8333-d70e37d3eab0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:44.559138 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d75c1367-a5e5-47d3-8333-d70e37d3eab0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:44.561526 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d75c1367-a5e5-47d3-8333-d70e37d3eab0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:44.562183 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d75c1367-a5e5-47d3-8333-d70e37d3eab0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:44.564657 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d75c1367-a5e5-47d3-8333-d70e37d3eab0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:44.565171 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d75c1367-a5e5-47d3-8333-d70e37d3eab0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:44.565635 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d75c1367-a5e5-47d3-8333-d70e37d3eab0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:44.589803 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=100 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:43:44.655432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d75c1367-a5e5-47d3-8333-d70e37d3eab0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:44.669662 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d75c1367-a5e5-47d3-8333-d70e37d3eab0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:44.672245 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d75c1367-a5e5-47d3-8333-d70e37d3eab0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:44.673717 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d75c1367-a5e5-47d3-8333-d70e37d3eab0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1285 microversion: 2.20 time: 0.139365 Aug 17 23:43:44.674551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 34/67] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:43:44 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:43:44.698608 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-aba10933-3018-4e5b-add8-1f0a742c482a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:44.706802 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-aba10933-3018-4e5b-add8-1f0a742c482a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.260574 Aug 17 23:43:44.720903 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 34/68] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:44 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:43:44.994994 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-bc0cc79e-a498-4af5-8a31-a8c989893e4c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:44.995993 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-bc0cc79e-a498-4af5-8a31-a8c989893e4c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:45.011729 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bc0cc79e-a498-4af5-8a31-a8c989893e4c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:45.012352 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bc0cc79e-a498-4af5-8a31-a8c989893e4c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:45.012895 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bc0cc79e-a498-4af5-8a31-a8c989893e4c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:45.013712 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bc0cc79e-a498-4af5-8a31-a8c989893e4c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:45.014361 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bc0cc79e-a498-4af5-8a31-a8c989893e4c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:45.014884 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bc0cc79e-a498-4af5-8a31-a8c989893e4c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:45.220443 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-bc0cc79e-a498-4af5-8a31-a8c989893e4c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:45.228746 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-bc0cc79e-a498-4af5-8a31-a8c989893e4c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.237684 Aug 17 23:43:45.229316 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 35/69] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:44 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:45.524076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f955eb10-74d9-4d7c-a8e8-590ee9152c4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:45.524736 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f955eb10-74d9-4d7c-a8e8-590ee9152c4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:45.530655 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f955eb10-74d9-4d7c-a8e8-590ee9152c4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:45.531132 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f955eb10-74d9-4d7c-a8e8-590ee9152c4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:45.531562 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f955eb10-74d9-4d7c-a8e8-590ee9152c4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:45.532259 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f955eb10-74d9-4d7c-a8e8-590ee9152c4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:45.532718 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f955eb10-74d9-4d7c-a8e8-590ee9152c4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:45.533136 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f955eb10-74d9-4d7c-a8e8-590ee9152c4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:45.669360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f955eb10-74d9-4d7c-a8e8-590ee9152c4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:45.676964 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f955eb10-74d9-4d7c-a8e8-590ee9152c4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.156816 Aug 17 23:43:45.677546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 35/70] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:45 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:45.697864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e7d76675-5958-4956-8a7c-e9342bea3d11 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:45.698543 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e7d76675-5958-4956-8a7c-e9342bea3d11 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:45.704564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e7d76675-5958-4956-8a7c-e9342bea3d11 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:45.704983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e7d76675-5958-4956-8a7c-e9342bea3d11 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:45.705417 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e7d76675-5958-4956-8a7c-e9342bea3d11 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:45.706108 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e7d76675-5958-4956-8a7c-e9342bea3d11 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:45.706562 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e7d76675-5958-4956-8a7c-e9342bea3d11 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:45.706987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e7d76675-5958-4956-8a7c-e9342bea3d11 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:45.726749 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b9051a23-e547-4dda-9a60-d6ff0a61c45d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:45.727468 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b9051a23-e547-4dda-9a60-d6ff0a61c45d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:45.733424 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b9051a23-e547-4dda-9a60-d6ff0a61c45d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:45.733970 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b9051a23-e547-4dda-9a60-d6ff0a61c45d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:45.734523 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b9051a23-e547-4dda-9a60-d6ff0a61c45d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:45.735278 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b9051a23-e547-4dda-9a60-d6ff0a61c45d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:45.735745 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b9051a23-e547-4dda-9a60-d6ff0a61c45d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:45.736205 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b9051a23-e547-4dda-9a60-d6ff0a61c45d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:45.900018 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e7d76675-5958-4956-8a7c-e9342bea3d11 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:45.908470 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e7d76675-5958-4956-8a7c-e9342bea3d11 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:45.912324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e7d76675-5958-4956-8a7c-e9342bea3d11 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:45.914107 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e7d76675-5958-4956-8a7c-e9342bea3d11 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1285 microversion: 2.20 time: 0.220922 Aug 17 23:43:45.920676 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b9051a23-e547-4dda-9a60-d6ff0a61c45d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:45.924372 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 36/71] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:43:45 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:43:45.932293 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b9051a23-e547-4dda-9a60-d6ff0a61c45d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.209166 Aug 17 23:43:45.933009 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 36/72] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:45 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:43:46.250412 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ac07eec0-8bc5-43bd-840b-b8be905cc971 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:46.251277 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ac07eec0-8bc5-43bd-840b-b8be905cc971 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:46.266177 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac07eec0-8bc5-43bd-840b-b8be905cc971 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:46.266944 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac07eec0-8bc5-43bd-840b-b8be905cc971 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:46.267562 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac07eec0-8bc5-43bd-840b-b8be905cc971 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:46.268660 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac07eec0-8bc5-43bd-840b-b8be905cc971 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:46.269096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac07eec0-8bc5-43bd-840b-b8be905cc971 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:46.269524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac07eec0-8bc5-43bd-840b-b8be905cc971 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:46.458894 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ac07eec0-8bc5-43bd-840b-b8be905cc971 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:46.468328 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ac07eec0-8bc5-43bd-840b-b8be905cc971 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.221777 Aug 17 23:43:46.469149 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 37/73] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:46 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:46.698791 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b59bff20-2890-4fc4-b3c7-8239a47f1019 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:46.699700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b59bff20-2890-4fc4-b3c7-8239a47f1019 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:46.709050 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b59bff20-2890-4fc4-b3c7-8239a47f1019 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:46.709640 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b59bff20-2890-4fc4-b3c7-8239a47f1019 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:46.710151 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b59bff20-2890-4fc4-b3c7-8239a47f1019 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:46.710952 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b59bff20-2890-4fc4-b3c7-8239a47f1019 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:46.711489 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b59bff20-2890-4fc4-b3c7-8239a47f1019 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:46.712129 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b59bff20-2890-4fc4-b3c7-8239a47f1019 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:46.846022 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b59bff20-2890-4fc4-b3c7-8239a47f1019 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:46.854382 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b59bff20-2890-4fc4-b3c7-8239a47f1019 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.159574 Aug 17 23:43:46.854950 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 37/74] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:46 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:46.939650 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-5685228e-14e7-496e-9f09-4732a630503c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:46.940304 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-5685228e-14e7-496e-9f09-4732a630503c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:46.946331 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5685228e-14e7-496e-9f09-4732a630503c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:46.946820 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5685228e-14e7-496e-9f09-4732a630503c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:46.947266 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5685228e-14e7-496e-9f09-4732a630503c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:46.948456 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5685228e-14e7-496e-9f09-4732a630503c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:46.948866 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5685228e-14e7-496e-9f09-4732a630503c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:46.949327 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5685228e-14e7-496e-9f09-4732a630503c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:46.954773 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-14f9e4bd-ea25-440e-a510-cfafe8eec05b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:46.954773 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-14f9e4bd-ea25-440e-a510-cfafe8eec05b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:46.960603 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-14f9e4bd-ea25-440e-a510-cfafe8eec05b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:46.961193 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-14f9e4bd-ea25-440e-a510-cfafe8eec05b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:46.961708 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-14f9e4bd-ea25-440e-a510-cfafe8eec05b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:46.962478 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-14f9e4bd-ea25-440e-a510-cfafe8eec05b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:46.963026 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-14f9e4bd-ea25-440e-a510-cfafe8eec05b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:46.963524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-14f9e4bd-ea25-440e-a510-cfafe8eec05b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:47.014139 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5685228e-14e7-496e-9f09-4732a630503c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:47.022177 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5685228e-14e7-496e-9f09-4732a630503c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:47.025233 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5685228e-14e7-496e-9f09-4732a630503c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:47.026377 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-5685228e-14e7-496e-9f09-4732a630503c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1285 microversion: 2.20 time: 0.090535 Aug 17 23:43:47.026936 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 38/75] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:43:46 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:43:47.091802 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-14f9e4bd-ea25-440e-a510-cfafe8eec05b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:47.099117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-14f9e4bd-ea25-440e-a510-cfafe8eec05b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.149914 Aug 17 23:43:47.099682 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 38/76] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:46 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:47.490298 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-40606bab-e8c0-4a87-b71a-3a0437d3bdd3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:47.491453 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-40606bab-e8c0-4a87-b71a-3a0437d3bdd3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:47.498382 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-40606bab-e8c0-4a87-b71a-3a0437d3bdd3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:47.498875 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-40606bab-e8c0-4a87-b71a-3a0437d3bdd3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:47.499317 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-40606bab-e8c0-4a87-b71a-3a0437d3bdd3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:47.500278 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-40606bab-e8c0-4a87-b71a-3a0437d3bdd3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:47.500921 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-40606bab-e8c0-4a87-b71a-3a0437d3bdd3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:47.501708 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-40606bab-e8c0-4a87-b71a-3a0437d3bdd3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:47.667373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-40606bab-e8c0-4a87-b71a-3a0437d3bdd3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:47.675531 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-40606bab-e8c0-4a87-b71a-3a0437d3bdd3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.190129 Aug 17 23:43:47.676783 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 39/77] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:47 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:47.877174 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-81d6d5a9-6de1-4a55-8597-92d7bbda0bc5 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:47.879254 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-81d6d5a9-6de1-4a55-8597-92d7bbda0bc5 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:47.888781 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-81d6d5a9-6de1-4a55-8597-92d7bbda0bc5 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:47.889635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-81d6d5a9-6de1-4a55-8597-92d7bbda0bc5 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:47.890139 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-81d6d5a9-6de1-4a55-8597-92d7bbda0bc5 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:47.890947 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-81d6d5a9-6de1-4a55-8597-92d7bbda0bc5 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:47.891851 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-81d6d5a9-6de1-4a55-8597-92d7bbda0bc5 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:47.892641 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-81d6d5a9-6de1-4a55-8597-92d7bbda0bc5 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:48.037538 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-81d6d5a9-6de1-4a55-8597-92d7bbda0bc5 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:48.046909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-81d6d5a9-6de1-4a55-8597-92d7bbda0bc5 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.175656 Aug 17 23:43:48.047495 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 39/78] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:47 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:48.049570 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-dd5d720e-462b-459c-98c8-ccd3df4ebd3f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:48.050221 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-dd5d720e-462b-459c-98c8-ccd3df4ebd3f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:48.057014 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dd5d720e-462b-459c-98c8-ccd3df4ebd3f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:48.058201 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dd5d720e-462b-459c-98c8-ccd3df4ebd3f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:48.058201 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dd5d720e-462b-459c-98c8-ccd3df4ebd3f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:48.058967 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dd5d720e-462b-459c-98c8-ccd3df4ebd3f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:48.059612 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dd5d720e-462b-459c-98c8-ccd3df4ebd3f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:48.060219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dd5d720e-462b-459c-98c8-ccd3df4ebd3f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:48.120443 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-750b9685-3154-4d2f-88cf-483ee5930c78 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:48.121150 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-750b9685-3154-4d2f-88cf-483ee5930c78 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:48.126137 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dd5d720e-462b-459c-98c8-ccd3df4ebd3f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:48.127169 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-750b9685-3154-4d2f-88cf-483ee5930c78 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:48.127662 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-750b9685-3154-4d2f-88cf-483ee5930c78 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:48.128143 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-750b9685-3154-4d2f-88cf-483ee5930c78 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:48.128844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-750b9685-3154-4d2f-88cf-483ee5930c78 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:48.129428 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-750b9685-3154-4d2f-88cf-483ee5930c78 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:48.129861 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-750b9685-3154-4d2f-88cf-483ee5930c78 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:48.133885 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=100 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:43:48.134864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dd5d720e-462b-459c-98c8-ccd3df4ebd3f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:48.136656 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dd5d720e-462b-459c-98c8-ccd3df4ebd3f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:48.137765 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-dd5d720e-462b-459c-98c8-ccd3df4ebd3f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1285 microversion: 2.20 time: 0.092688 Aug 17 23:43:48.138323 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 40/79] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:43:48 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:43:48.241516 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=8 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:43:48.256948 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-750b9685-3154-4d2f-88cf-483ee5930c78 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:48.264643 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-750b9685-3154-4d2f-88cf-483ee5930c78 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.148180 Aug 17 23:43:48.265207 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 40/80] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:48 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:43:48.696342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-3492a224-755e-4240-8330-3c55c393e0ac tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:48.696961 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-3492a224-755e-4240-8330-3c55c393e0ac tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:48.702784 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3492a224-755e-4240-8330-3c55c393e0ac tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:48.703273 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3492a224-755e-4240-8330-3c55c393e0ac tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:48.703762 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3492a224-755e-4240-8330-3c55c393e0ac tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:48.704422 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3492a224-755e-4240-8330-3c55c393e0ac tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:48.704886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3492a224-755e-4240-8330-3c55c393e0ac tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:48.705310 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3492a224-755e-4240-8330-3c55c393e0ac tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:48.831320 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-3492a224-755e-4240-8330-3c55c393e0ac tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:48.839627 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-3492a224-755e-4240-8330-3c55c393e0ac tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.147123 Aug 17 23:43:48.840222 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 41/81] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:48 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:49.068594 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-55faeba4-069a-4628-901a-ca17097c1859 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:49.069203 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-55faeba4-069a-4628-901a-ca17097c1859 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:49.071142 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=34 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:43:49.077841 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-55faeba4-069a-4628-901a-ca17097c1859 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:49.078341 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-55faeba4-069a-4628-901a-ca17097c1859 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:49.078785 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-55faeba4-069a-4628-901a-ca17097c1859 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:49.079496 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-55faeba4-069a-4628-901a-ca17097c1859 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:49.079954 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-55faeba4-069a-4628-901a-ca17097c1859 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:49.080442 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-55faeba4-069a-4628-901a-ca17097c1859 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:49.161014 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-4f5fa1b2-137c-4847-8c38-af62669f51f2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:49.161626 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-4f5fa1b2-137c-4847-8c38-af62669f51f2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:49.167570 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4f5fa1b2-137c-4847-8c38-af62669f51f2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:49.168208 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4f5fa1b2-137c-4847-8c38-af62669f51f2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:49.168646 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4f5fa1b2-137c-4847-8c38-af62669f51f2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:49.169334 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4f5fa1b2-137c-4847-8c38-af62669f51f2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:49.169786 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4f5fa1b2-137c-4847-8c38-af62669f51f2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:49.170209 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4f5fa1b2-137c-4847-8c38-af62669f51f2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:49.214768 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-55faeba4-069a-4628-901a-ca17097c1859 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:49.222674 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-55faeba4-069a-4628-901a-ca17097c1859 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.157916 Aug 17 23:43:49.223474 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 41/82] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:49 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:49.243370 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-4f5fa1b2-137c-4847-8c38-af62669f51f2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:49.252891 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-4f5fa1b2-137c-4847-8c38-af62669f51f2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:49.254395 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-4f5fa1b2-137c-4847-8c38-af62669f51f2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:49.255529 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-4f5fa1b2-137c-4847-8c38-af62669f51f2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1285 microversion: 2.20 time: 0.098702 Aug 17 23:43:49.256104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 42/83] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:43:49 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:43:49.285689 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-23d9c290-c26d-4102-ae43-261f0d64627f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:49.286307 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-23d9c290-c26d-4102-ae43-261f0d64627f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:49.297882 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23d9c290-c26d-4102-ae43-261f0d64627f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:49.297882 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23d9c290-c26d-4102-ae43-261f0d64627f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:49.298168 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23d9c290-c26d-4102-ae43-261f0d64627f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:49.302235 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23d9c290-c26d-4102-ae43-261f0d64627f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:49.302948 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23d9c290-c26d-4102-ae43-261f0d64627f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:49.303673 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23d9c290-c26d-4102-ae43-261f0d64627f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:49.445130 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-23d9c290-c26d-4102-ae43-261f0d64627f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:49.454180 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-23d9c290-c26d-4102-ae43-261f0d64627f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.172534 Aug 17 23:43:49.455120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 42/84] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:49 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:49.860213 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-393c8a12-8616-47e0-8e92-29da4f013010 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:49.860744 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-393c8a12-8616-47e0-8e92-29da4f013010 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:49.866878 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-393c8a12-8616-47e0-8e92-29da4f013010 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:49.867367 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-393c8a12-8616-47e0-8e92-29da4f013010 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:49.867800 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-393c8a12-8616-47e0-8e92-29da4f013010 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:49.869120 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-393c8a12-8616-47e0-8e92-29da4f013010 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:49.869573 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-393c8a12-8616-47e0-8e92-29da4f013010 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:49.869995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-393c8a12-8616-47e0-8e92-29da4f013010 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:50.006735 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-393c8a12-8616-47e0-8e92-29da4f013010 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:50.014259 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-393c8a12-8616-47e0-8e92-29da4f013010 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.157986 Aug 17 23:43:50.014824 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 43/85] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:49 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:50.243128 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0cb3c7f3-db8c-41d2-9e93-dfd7f2e6a426 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:50.243746 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0cb3c7f3-db8c-41d2-9e93-dfd7f2e6a426 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:50.249785 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0cb3c7f3-db8c-41d2-9e93-dfd7f2e6a426 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:50.250268 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0cb3c7f3-db8c-41d2-9e93-dfd7f2e6a426 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:50.250741 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0cb3c7f3-db8c-41d2-9e93-dfd7f2e6a426 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:50.251447 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0cb3c7f3-db8c-41d2-9e93-dfd7f2e6a426 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:50.251893 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0cb3c7f3-db8c-41d2-9e93-dfd7f2e6a426 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:50.252367 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0cb3c7f3-db8c-41d2-9e93-dfd7f2e6a426 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:50.284037 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-bef28171-86f2-4621-ba60-b338ab62294a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:50.285078 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-bef28171-86f2-4621-ba60-b338ab62294a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:50.292934 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bef28171-86f2-4621-ba60-b338ab62294a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:50.300211 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bef28171-86f2-4621-ba60-b338ab62294a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:50.304498 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bef28171-86f2-4621-ba60-b338ab62294a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:50.306683 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bef28171-86f2-4621-ba60-b338ab62294a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:50.307980 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bef28171-86f2-4621-ba60-b338ab62294a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:50.308820 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bef28171-86f2-4621-ba60-b338ab62294a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:50.397307 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-bef28171-86f2-4621-ba60-b338ab62294a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:50.419452 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-bef28171-86f2-4621-ba60-b338ab62294a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:50.428304 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-bef28171-86f2-4621-ba60-b338ab62294a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:50.429576 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-bef28171-86f2-4621-ba60-b338ab62294a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1285 microversion: 2.20 time: 0.155121 Aug 17 23:43:50.444439 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 44/86] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:43:50 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:43:50.470530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0cb3c7f3-db8c-41d2-9e93-dfd7f2e6a426 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:50.475843 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-54e5dd7d-23f1-4910-8f7a-3b8942e4ec59 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:50.476578 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-54e5dd7d-23f1-4910-8f7a-3b8942e4ec59 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:50.483509 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-54e5dd7d-23f1-4910-8f7a-3b8942e4ec59 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:50.484087 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-54e5dd7d-23f1-4910-8f7a-3b8942e4ec59 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:50.484528 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-54e5dd7d-23f1-4910-8f7a-3b8942e4ec59 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:50.485218 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-54e5dd7d-23f1-4910-8f7a-3b8942e4ec59 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:50.485868 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-54e5dd7d-23f1-4910-8f7a-3b8942e4ec59 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:50.486495 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-54e5dd7d-23f1-4910-8f7a-3b8942e4ec59 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:50.486922 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0cb3c7f3-db8c-41d2-9e93-dfd7f2e6a426 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.247258 Aug 17 23:43:50.488746 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 43/87] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:50 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:50.681967 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-54e5dd7d-23f1-4910-8f7a-3b8942e4ec59 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:50.690149 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-54e5dd7d-23f1-4910-8f7a-3b8942e4ec59 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.218256 Aug 17 23:43:50.690742 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 45/88] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:50 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:43:51.034902 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-035bb262-30e0-45a6-91b1-78a7c14c344d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:51.035534 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-035bb262-30e0-45a6-91b1-78a7c14c344d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:51.041527 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-035bb262-30e0-45a6-91b1-78a7c14c344d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:51.041943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-035bb262-30e0-45a6-91b1-78a7c14c344d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:51.042371 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-035bb262-30e0-45a6-91b1-78a7c14c344d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:51.043047 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-035bb262-30e0-45a6-91b1-78a7c14c344d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:51.043495 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-035bb262-30e0-45a6-91b1-78a7c14c344d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:51.043913 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-035bb262-30e0-45a6-91b1-78a7c14c344d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:51.173518 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-035bb262-30e0-45a6-91b1-78a7c14c344d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:51.180844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-035bb262-30e0-45a6-91b1-78a7c14c344d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.150081 Aug 17 23:43:51.182001 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 44/89] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:51 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:51.451510 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1b48b60a-4a97-427b-8308-fdd04844e8f8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:51.452146 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1b48b60a-4a97-427b-8308-fdd04844e8f8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:51.455202 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:43:51.459721 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1b48b60a-4a97-427b-8308-fdd04844e8f8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:51.460230 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1b48b60a-4a97-427b-8308-fdd04844e8f8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:51.460661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1b48b60a-4a97-427b-8308-fdd04844e8f8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:51.461356 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1b48b60a-4a97-427b-8308-fdd04844e8f8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:51.461802 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1b48b60a-4a97-427b-8308-fdd04844e8f8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:51.462484 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1b48b60a-4a97-427b-8308-fdd04844e8f8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:51.511378 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9960ab47-6271-42b1-8a2a-c94ee0a2bb1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:51.512020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9960ab47-6271-42b1-8a2a-c94ee0a2bb1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:51.517950 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9960ab47-6271-42b1-8a2a-c94ee0a2bb1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:51.518433 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9960ab47-6271-42b1-8a2a-c94ee0a2bb1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:51.518898 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9960ab47-6271-42b1-8a2a-c94ee0a2bb1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:51.519586 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9960ab47-6271-42b1-8a2a-c94ee0a2bb1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:51.520068 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9960ab47-6271-42b1-8a2a-c94ee0a2bb1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:51.520495 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9960ab47-6271-42b1-8a2a-c94ee0a2bb1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:51.525389 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1b48b60a-4a97-427b-8308-fdd04844e8f8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:51.533510 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1b48b60a-4a97-427b-8308-fdd04844e8f8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:51.535278 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1b48b60a-4a97-427b-8308-fdd04844e8f8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:51.536396 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1b48b60a-4a97-427b-8308-fdd04844e8f8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1285 microversion: 2.20 time: 0.088819 Aug 17 23:43:51.536952 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 46/90] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:43:51 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:43:51.646390 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9960ab47-6271-42b1-8a2a-c94ee0a2bb1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:51.654159 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9960ab47-6271-42b1-8a2a-c94ee0a2bb1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.146632 Aug 17 23:43:51.654728 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 45/91] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:51 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:51.710757 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-50a4feb8-99ba-4e50-a567-5cdacac2624e tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:51.711363 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-50a4feb8-99ba-4e50-a567-5cdacac2624e tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:51.717674 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-50a4feb8-99ba-4e50-a567-5cdacac2624e tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:51.718153 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-50a4feb8-99ba-4e50-a567-5cdacac2624e tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:51.718582 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-50a4feb8-99ba-4e50-a567-5cdacac2624e tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:51.719257 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-50a4feb8-99ba-4e50-a567-5cdacac2624e tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:51.719711 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-50a4feb8-99ba-4e50-a567-5cdacac2624e tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:51.720157 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-50a4feb8-99ba-4e50-a567-5cdacac2624e tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:51.856579 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-50a4feb8-99ba-4e50-a567-5cdacac2624e tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:51.864802 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-50a4feb8-99ba-4e50-a567-5cdacac2624e tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.157728 Aug 17 23:43:51.865388 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 47/92] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:51 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:52.202323 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-8ee72a6c-a6d1-4965-86f0-cd33aeece3fa tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:52.202934 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-8ee72a6c-a6d1-4965-86f0-cd33aeece3fa tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:52.210107 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8ee72a6c-a6d1-4965-86f0-cd33aeece3fa tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:52.210601 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8ee72a6c-a6d1-4965-86f0-cd33aeece3fa tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:52.211039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8ee72a6c-a6d1-4965-86f0-cd33aeece3fa tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:52.211736 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8ee72a6c-a6d1-4965-86f0-cd33aeece3fa tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:52.212221 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8ee72a6c-a6d1-4965-86f0-cd33aeece3fa tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:52.213258 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8ee72a6c-a6d1-4965-86f0-cd33aeece3fa tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:52.496020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8ee72a6c-a6d1-4965-86f0-cd33aeece3fa tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:52.503437 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-8ee72a6c-a6d1-4965-86f0-cd33aeece3fa tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.305052 Aug 17 23:43:52.504254 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 46/93] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:52 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:43:52.559314 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d1f3056d-3d43-466a-9def-35b034907ada tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:52.560058 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d1f3056d-3d43-466a-9def-35b034907ada tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:52.565959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d1f3056d-3d43-466a-9def-35b034907ada tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:52.566441 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d1f3056d-3d43-466a-9def-35b034907ada tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:52.566870 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d1f3056d-3d43-466a-9def-35b034907ada tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:52.567548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d1f3056d-3d43-466a-9def-35b034907ada tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:52.568025 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d1f3056d-3d43-466a-9def-35b034907ada tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:52.568446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d1f3056d-3d43-466a-9def-35b034907ada tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:52.633452 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d1f3056d-3d43-466a-9def-35b034907ada tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:52.641391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d1f3056d-3d43-466a-9def-35b034907ada tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:52.642887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d1f3056d-3d43-466a-9def-35b034907ada tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:52.643997 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d1f3056d-3d43-466a-9def-35b034907ada tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1285 microversion: 2.20 time: 0.089311 Aug 17 23:43:52.644543 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 48/94] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:43:52 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:43:52.674652 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5d71d922-e08b-4e22-8be0-8f3eaa1abdf4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:52.675412 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5d71d922-e08b-4e22-8be0-8f3eaa1abdf4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:52.681481 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d71d922-e08b-4e22-8be0-8f3eaa1abdf4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:52.682040 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d71d922-e08b-4e22-8be0-8f3eaa1abdf4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:52.683144 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d71d922-e08b-4e22-8be0-8f3eaa1abdf4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:52.683843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d71d922-e08b-4e22-8be0-8f3eaa1abdf4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:52.684320 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d71d922-e08b-4e22-8be0-8f3eaa1abdf4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:52.684745 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d71d922-e08b-4e22-8be0-8f3eaa1abdf4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:52.828276 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5d71d922-e08b-4e22-8be0-8f3eaa1abdf4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:52.835914 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5d71d922-e08b-4e22-8be0-8f3eaa1abdf4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.165230 Aug 17 23:43:52.836511 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 47/95] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:52 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:52.886094 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-510a2402-b5d1-4b4a-9f89-280f29ada0f8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:52.886661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-510a2402-b5d1-4b4a-9f89-280f29ada0f8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:52.893627 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-510a2402-b5d1-4b4a-9f89-280f29ada0f8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:52.894135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-510a2402-b5d1-4b4a-9f89-280f29ada0f8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:52.894553 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-510a2402-b5d1-4b4a-9f89-280f29ada0f8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:52.895247 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-510a2402-b5d1-4b4a-9f89-280f29ada0f8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:52.895712 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-510a2402-b5d1-4b4a-9f89-280f29ada0f8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:52.896166 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-510a2402-b5d1-4b4a-9f89-280f29ada0f8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:53.030117 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-510a2402-b5d1-4b4a-9f89-280f29ada0f8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:53.038234 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-510a2402-b5d1-4b4a-9f89-280f29ada0f8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.156595 Aug 17 23:43:53.038796 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 49/96] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:52 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:53.524495 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ad5b7550-9a49-49c3-ab59-124433f18fd1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:53.525108 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ad5b7550-9a49-49c3-ab59-124433f18fd1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:53.531636 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ad5b7550-9a49-49c3-ab59-124433f18fd1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:53.532183 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ad5b7550-9a49-49c3-ab59-124433f18fd1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:53.532617 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ad5b7550-9a49-49c3-ab59-124433f18fd1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:53.533300 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ad5b7550-9a49-49c3-ab59-124433f18fd1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:53.533754 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ad5b7550-9a49-49c3-ab59-124433f18fd1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:53.534178 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ad5b7550-9a49-49c3-ab59-124433f18fd1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:53.661924 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ad5b7550-9a49-49c3-ab59-124433f18fd1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:53.666663 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8c0ed538-19ad-47b2-98d4-19871bc30d85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:53.667411 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8c0ed538-19ad-47b2-98d4-19871bc30d85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:53.669686 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ad5b7550-9a49-49c3-ab59-124433f18fd1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.149037 Aug 17 23:43:53.670252 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 48/97] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:53 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:53.673508 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8c0ed538-19ad-47b2-98d4-19871bc30d85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:53.673986 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8c0ed538-19ad-47b2-98d4-19871bc30d85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:53.674510 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8c0ed538-19ad-47b2-98d4-19871bc30d85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:53.675104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8c0ed538-19ad-47b2-98d4-19871bc30d85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:53.675550 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8c0ed538-19ad-47b2-98d4-19871bc30d85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:53.676047 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8c0ed538-19ad-47b2-98d4-19871bc30d85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:53.735445 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-8c0ed538-19ad-47b2-98d4-19871bc30d85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:53.738781 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=100 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:43:53.743981 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-8c0ed538-19ad-47b2-98d4-19871bc30d85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:53.746006 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-8c0ed538-19ad-47b2-98d4-19871bc30d85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:53.747166 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8c0ed538-19ad-47b2-98d4-19871bc30d85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1285 microversion: 2.20 time: 0.084673 Aug 17 23:43:53.747721 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 50/98] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:43:53 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:43:53.856377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5407b2fa-cc7d-4d42-8ef4-9508f8bf02d8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:53.856984 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5407b2fa-cc7d-4d42-8ef4-9508f8bf02d8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:53.862821 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5407b2fa-cc7d-4d42-8ef4-9508f8bf02d8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:53.863295 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5407b2fa-cc7d-4d42-8ef4-9508f8bf02d8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:53.863725 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5407b2fa-cc7d-4d42-8ef4-9508f8bf02d8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:53.864424 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5407b2fa-cc7d-4d42-8ef4-9508f8bf02d8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:53.864877 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5407b2fa-cc7d-4d42-8ef4-9508f8bf02d8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:53.865296 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5407b2fa-cc7d-4d42-8ef4-9508f8bf02d8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:53.989757 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5407b2fa-cc7d-4d42-8ef4-9508f8bf02d8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:53.997776 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5407b2fa-cc7d-4d42-8ef4-9508f8bf02d8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.145206 Aug 17 23:43:53.998349 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 49/99] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:53 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:54.059180 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9b0c4039-fd9a-4641-a8e3-f4519cf0f1c1 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:54.059871 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9b0c4039-fd9a-4641-a8e3-f4519cf0f1c1 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:54.065979 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9b0c4039-fd9a-4641-a8e3-f4519cf0f1c1 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:54.066546 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9b0c4039-fd9a-4641-a8e3-f4519cf0f1c1 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:54.067046 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9b0c4039-fd9a-4641-a8e3-f4519cf0f1c1 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:54.067765 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9b0c4039-fd9a-4641-a8e3-f4519cf0f1c1 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:54.068245 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9b0c4039-fd9a-4641-a8e3-f4519cf0f1c1 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:54.068677 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9b0c4039-fd9a-4641-a8e3-f4519cf0f1c1 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:54.202988 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9b0c4039-fd9a-4641-a8e3-f4519cf0f1c1 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:54.210585 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9b0c4039-fd9a-4641-a8e3-f4519cf0f1c1 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.155869 Aug 17 23:43:54.211144 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 51/100] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:54 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:54.691420 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-bbfca6ff-edd8-420d-ae97-0ad237f125cd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:54.692075 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-bbfca6ff-edd8-420d-ae97-0ad237f125cd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:54.698557 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bbfca6ff-edd8-420d-ae97-0ad237f125cd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:54.699038 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bbfca6ff-edd8-420d-ae97-0ad237f125cd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:54.699471 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bbfca6ff-edd8-420d-ae97-0ad237f125cd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:54.700180 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bbfca6ff-edd8-420d-ae97-0ad237f125cd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:54.700632 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bbfca6ff-edd8-420d-ae97-0ad237f125cd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:54.701052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bbfca6ff-edd8-420d-ae97-0ad237f125cd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:54.769637 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-5a128c12-0eb6-46ee-8e73-808d975f9305 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:54.770362 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-5a128c12-0eb6-46ee-8e73-808d975f9305 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:54.776627 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5a128c12-0eb6-46ee-8e73-808d975f9305 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:54.777221 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5a128c12-0eb6-46ee-8e73-808d975f9305 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:54.777667 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5a128c12-0eb6-46ee-8e73-808d975f9305 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:54.778392 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5a128c12-0eb6-46ee-8e73-808d975f9305 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:54.778987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5a128c12-0eb6-46ee-8e73-808d975f9305 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:54.779548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5a128c12-0eb6-46ee-8e73-808d975f9305 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:54.829688 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-bbfca6ff-edd8-420d-ae97-0ad237f125cd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:54.839056 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-bbfca6ff-edd8-420d-ae97-0ad237f125cd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.151168 Aug 17 23:43:54.840581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 50/101] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:54 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:54.855453 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5a128c12-0eb6-46ee-8e73-808d975f9305 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:54.863285 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5a128c12-0eb6-46ee-8e73-808d975f9305 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:54.864815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5a128c12-0eb6-46ee-8e73-808d975f9305 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:54.865935 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-5a128c12-0eb6-46ee-8e73-808d975f9305 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1285 microversion: 2.20 time: 0.100224 Aug 17 23:43:54.866485 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 52/102] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:43:54 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:43:55.019489 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-6815223c-848b-4317-93e3-f2e9294ba9fc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:55.020599 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-6815223c-848b-4317-93e3-f2e9294ba9fc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:55.026121 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6815223c-848b-4317-93e3-f2e9294ba9fc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:55.026600 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6815223c-848b-4317-93e3-f2e9294ba9fc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:55.027035 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6815223c-848b-4317-93e3-f2e9294ba9fc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:55.027718 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6815223c-848b-4317-93e3-f2e9294ba9fc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:55.028213 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6815223c-848b-4317-93e3-f2e9294ba9fc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:55.028638 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6815223c-848b-4317-93e3-f2e9294ba9fc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:55.161875 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-6815223c-848b-4317-93e3-f2e9294ba9fc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:55.169818 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-6815223c-848b-4317-93e3-f2e9294ba9fc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.154187 Aug 17 23:43:55.170371 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 51/103] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:55 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:55.231499 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c4849c11-3cd3-4652-b45a-a33e568a1167 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:55.232181 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c4849c11-3cd3-4652-b45a-a33e568a1167 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:55.238085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c4849c11-3cd3-4652-b45a-a33e568a1167 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:55.238571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c4849c11-3cd3-4652-b45a-a33e568a1167 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:55.239014 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c4849c11-3cd3-4652-b45a-a33e568a1167 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:55.239703 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c4849c11-3cd3-4652-b45a-a33e568a1167 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:55.240197 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c4849c11-3cd3-4652-b45a-a33e568a1167 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:55.240628 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c4849c11-3cd3-4652-b45a-a33e568a1167 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:55.370718 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c4849c11-3cd3-4652-b45a-a33e568a1167 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:55.378067 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c4849c11-3cd3-4652-b45a-a33e568a1167 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.151073 Aug 17 23:43:55.378632 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 53/104] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:55 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:55.859636 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-039ef97c-fadd-4d56-a08d-5ea792fc740d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:55.860288 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-039ef97c-fadd-4d56-a08d-5ea792fc740d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:55.866122 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-039ef97c-fadd-4d56-a08d-5ea792fc740d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:55.866611 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-039ef97c-fadd-4d56-a08d-5ea792fc740d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:55.867043 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-039ef97c-fadd-4d56-a08d-5ea792fc740d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:55.867740 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-039ef97c-fadd-4d56-a08d-5ea792fc740d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:55.868214 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-039ef97c-fadd-4d56-a08d-5ea792fc740d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:55.868639 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-039ef97c-fadd-4d56-a08d-5ea792fc740d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:55.890143 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-edb784b5-2e82-45c1-8416-4ade3b6324a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:55.890772 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-edb784b5-2e82-45c1-8416-4ade3b6324a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:55.897421 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-edb784b5-2e82-45c1-8416-4ade3b6324a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:55.897911 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-edb784b5-2e82-45c1-8416-4ade3b6324a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:55.898347 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-edb784b5-2e82-45c1-8416-4ade3b6324a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:55.899040 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-edb784b5-2e82-45c1-8416-4ade3b6324a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:55.899494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-edb784b5-2e82-45c1-8416-4ade3b6324a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:55.899918 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-edb784b5-2e82-45c1-8416-4ade3b6324a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:55.967453 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-edb784b5-2e82-45c1-8416-4ade3b6324a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:55.975343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-edb784b5-2e82-45c1-8416-4ade3b6324a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:55.976848 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-edb784b5-2e82-45c1-8416-4ade3b6324a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:55.977928 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-edb784b5-2e82-45c1-8416-4ade3b6324a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1285 microversion: 2.20 time: 0.093616 Aug 17 23:43:55.978477 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 54/105] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:43:55 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:43:55.999890 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-039ef97c-fadd-4d56-a08d-5ea792fc740d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:56.007203 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-039ef97c-fadd-4d56-a08d-5ea792fc740d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.151366 Aug 17 23:43:56.007750 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 52/106] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:55 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:56.190417 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-85ea2343-b03c-424f-aa1b-e52678e8eec0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:56.191035 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-85ea2343-b03c-424f-aa1b-e52678e8eec0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:56.196971 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85ea2343-b03c-424f-aa1b-e52678e8eec0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:56.197472 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85ea2343-b03c-424f-aa1b-e52678e8eec0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:56.198479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85ea2343-b03c-424f-aa1b-e52678e8eec0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:56.199173 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85ea2343-b03c-424f-aa1b-e52678e8eec0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:56.199631 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85ea2343-b03c-424f-aa1b-e52678e8eec0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:56.200085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85ea2343-b03c-424f-aa1b-e52678e8eec0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:56.326718 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-85ea2343-b03c-424f-aa1b-e52678e8eec0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:56.333938 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-85ea2343-b03c-424f-aa1b-e52678e8eec0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.147325 Aug 17 23:43:56.334494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 55/107] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:56 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:56.397830 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-89c6f855-579b-43db-8d1c-7a19a0dd5cf4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:56.398360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-89c6f855-579b-43db-8d1c-7a19a0dd5cf4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:56.404826 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-89c6f855-579b-43db-8d1c-7a19a0dd5cf4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:56.405310 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-89c6f855-579b-43db-8d1c-7a19a0dd5cf4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:56.405763 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-89c6f855-579b-43db-8d1c-7a19a0dd5cf4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:56.406451 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-89c6f855-579b-43db-8d1c-7a19a0dd5cf4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:56.406893 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-89c6f855-579b-43db-8d1c-7a19a0dd5cf4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:56.407314 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-89c6f855-579b-43db-8d1c-7a19a0dd5cf4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:56.538091 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-89c6f855-579b-43db-8d1c-7a19a0dd5cf4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:56.545443 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-89c6f855-579b-43db-8d1c-7a19a0dd5cf4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.151569 Aug 17 23:43:56.546011 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 53/108] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:56 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:57.000321 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-aa8c398b-fceb-4667-9231-e35aa0d0e8c6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:57.000923 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-aa8c398b-fceb-4667-9231-e35aa0d0e8c6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:57.006836 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aa8c398b-fceb-4667-9231-e35aa0d0e8c6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:57.007312 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aa8c398b-fceb-4667-9231-e35aa0d0e8c6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:57.007741 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aa8c398b-fceb-4667-9231-e35aa0d0e8c6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:57.008444 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aa8c398b-fceb-4667-9231-e35aa0d0e8c6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:57.008898 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aa8c398b-fceb-4667-9231-e35aa0d0e8c6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:57.009312 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aa8c398b-fceb-4667-9231-e35aa0d0e8c6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:57.028036 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-83272918-42cc-4701-a928-6dfa01873c8b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:57.028656 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-83272918-42cc-4701-a928-6dfa01873c8b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:57.034530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-83272918-42cc-4701-a928-6dfa01873c8b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:57.035286 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-83272918-42cc-4701-a928-6dfa01873c8b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:57.035731 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-83272918-42cc-4701-a928-6dfa01873c8b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:57.036451 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-83272918-42cc-4701-a928-6dfa01873c8b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:57.036915 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-83272918-42cc-4701-a928-6dfa01873c8b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:57.037340 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-83272918-42cc-4701-a928-6dfa01873c8b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:57.068984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-aa8c398b-fceb-4667-9231-e35aa0d0e8c6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:57.077515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-aa8c398b-fceb-4667-9231-e35aa0d0e8c6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:57.079038 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-aa8c398b-fceb-4667-9231-e35aa0d0e8c6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:57.080169 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-aa8c398b-fceb-4667-9231-e35aa0d0e8c6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1277 microversion: 2.20 time: 0.083644 Aug 17 23:43:57.080883 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 56/109] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:43:56 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:43:57.198521 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-83272918-42cc-4701-a928-6dfa01873c8b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:57.209560 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-83272918-42cc-4701-a928-6dfa01873c8b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.185244 Aug 17 23:43:57.210378 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 54/110] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:57 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:43:57.355554 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c1dd3db4-10d9-4218-b421-b93723a9d005 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:57.356612 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c1dd3db4-10d9-4218-b421-b93723a9d005 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:57.363265 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c1dd3db4-10d9-4218-b421-b93723a9d005 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:57.364267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c1dd3db4-10d9-4218-b421-b93723a9d005 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:57.364863 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c1dd3db4-10d9-4218-b421-b93723a9d005 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:57.365742 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c1dd3db4-10d9-4218-b421-b93723a9d005 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:57.366982 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c1dd3db4-10d9-4218-b421-b93723a9d005 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:57.367786 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c1dd3db4-10d9-4218-b421-b93723a9d005 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:57.567609 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-539cfcd0-09c2-4b59-81b9-c474e0e4d1e4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:57.568371 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-539cfcd0-09c2-4b59-81b9-c474e0e4d1e4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:57.576696 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-539cfcd0-09c2-4b59-81b9-c474e0e4d1e4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:57.577276 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-539cfcd0-09c2-4b59-81b9-c474e0e4d1e4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:57.578947 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-539cfcd0-09c2-4b59-81b9-c474e0e4d1e4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:57.579826 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-539cfcd0-09c2-4b59-81b9-c474e0e4d1e4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:57.580329 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-539cfcd0-09c2-4b59-81b9-c474e0e4d1e4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:57.580765 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-539cfcd0-09c2-4b59-81b9-c474e0e4d1e4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:57.770897 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c1dd3db4-10d9-4218-b421-b93723a9d005 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:57.780613 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c1dd3db4-10d9-4218-b421-b93723a9d005 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.430100 Aug 17 23:43:57.781665 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 57/111] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:57 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:57.831363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-539cfcd0-09c2-4b59-81b9-c474e0e4d1e4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:57.842815 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-539cfcd0-09c2-4b59-81b9-c474e0e4d1e4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.280268 Aug 17 23:43:57.845195 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 55/112] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:57 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:43:58.102755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-07c90fa8-a02d-49d1-8357-d0878ab1edc4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:58.104133 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-07c90fa8-a02d-49d1-8357-d0878ab1edc4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:58.112667 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-07c90fa8-a02d-49d1-8357-d0878ab1edc4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:58.113754 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-07c90fa8-a02d-49d1-8357-d0878ab1edc4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:58.114822 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-07c90fa8-a02d-49d1-8357-d0878ab1edc4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:58.115798 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-07c90fa8-a02d-49d1-8357-d0878ab1edc4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:58.116482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-07c90fa8-a02d-49d1-8357-d0878ab1edc4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:58.117101 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-07c90fa8-a02d-49d1-8357-d0878ab1edc4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:58.231470 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ffe80e1b-40a6-435a-b8d1-33a528abea82 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:58.232106 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ffe80e1b-40a6-435a-b8d1-33a528abea82 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:58.238516 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-07c90fa8-a02d-49d1-8357-d0878ab1edc4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:58.242776 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ffe80e1b-40a6-435a-b8d1-33a528abea82 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:58.243266 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ffe80e1b-40a6-435a-b8d1-33a528abea82 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:58.245238 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ffe80e1b-40a6-435a-b8d1-33a528abea82 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:58.246982 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ffe80e1b-40a6-435a-b8d1-33a528abea82 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:58.246982 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ffe80e1b-40a6-435a-b8d1-33a528abea82 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:58.246982 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ffe80e1b-40a6-435a-b8d1-33a528abea82 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:58.252908 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-07c90fa8-a02d-49d1-8357-d0878ab1edc4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:58.254410 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-07c90fa8-a02d-49d1-8357-d0878ab1edc4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:58.255524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-07c90fa8-a02d-49d1-8357-d0878ab1edc4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1339 microversion: 2.20 time: 0.156812 Aug 17 23:43:58.256467 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 58/113] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:43:58 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1339 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:43:58.804484 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-985bddd8-3fab-4853-af71-2c15c0577110 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:58.805557 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-985bddd8-3fab-4853-af71-2c15c0577110 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:58.814691 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-985bddd8-3fab-4853-af71-2c15c0577110 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:58.816638 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-985bddd8-3fab-4853-af71-2c15c0577110 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:58.820810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-985bddd8-3fab-4853-af71-2c15c0577110 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:58.821764 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-985bddd8-3fab-4853-af71-2c15c0577110 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:58.824508 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-985bddd8-3fab-4853-af71-2c15c0577110 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:58.825093 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-985bddd8-3fab-4853-af71-2c15c0577110 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:59.149782 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ffe80e1b-40a6-435a-b8d1-33a528abea82 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:59.156054 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=100 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:43:59.169128 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ffe80e1b-40a6-435a-b8d1-33a528abea82 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.937352 Aug 17 23:43:59.170068 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 56/114] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:58 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:43:59.195361 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-6cc9cc3f-2200-4251-8f9f-cfdb1a32a931 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:59.204730 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-6cc9cc3f-2200-4251-8f9f-cfdb1a32a931 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:59.211329 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6cc9cc3f-2200-4251-8f9f-cfdb1a32a931 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:59.212128 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6cc9cc3f-2200-4251-8f9f-cfdb1a32a931 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:59.212787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6cc9cc3f-2200-4251-8f9f-cfdb1a32a931 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:59.214519 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6cc9cc3f-2200-4251-8f9f-cfdb1a32a931 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:59.215180 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6cc9cc3f-2200-4251-8f9f-cfdb1a32a931 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:59.215800 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6cc9cc3f-2200-4251-8f9f-cfdb1a32a931 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:59.336144 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-985bddd8-3fab-4853-af71-2c15c0577110 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:59.347066 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-985bddd8-3fab-4853-af71-2c15c0577110 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.545939 Aug 17 23:43:59.348590 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 59/115] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:58 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:43:59.419187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-81dcc9af-4851-4c08-9d09-d83961678589 req-6c990b89-df37-44bd-93bc-f20ae90c74da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d619bf9d-15c1-4cef-bcc3-4a792878bf73", "tag": "f60e9126-8ff5-4a1e-bdee-fcf39e05162b"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:43:59.432494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-81dcc9af-4851-4c08-9d09-d83961678589 req-6c990b89-df37-44bd-93bc-f20ae90c74da service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:59.433001 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-81dcc9af-4851-4c08-9d09-d83961678589 req-6c990b89-df37-44bd-93bc-f20ae90c74da service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:59.433513 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-81dcc9af-4851-4c08-9d09-d83961678589 req-6c990b89-df37-44bd-93bc-f20ae90c74da service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:59.460882 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-81dcc9af-4851-4c08-9d09-d83961678589 req-6c990b89-df37-44bd-93bc-f20ae90c74da service nova] Creating event network-changed:f60e9126-8ff5-4a1e-bdee-fcf39e05162b for instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 on hv-cinder-82002 Aug 17 23:43:59.461394 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-81dcc9af-4851-4c08-9d09-d83961678589 req-6c990b89-df37-44bd-93bc-f20ae90c74da service nova] Acquiring lock "compute-rpcapi-router" {{(pid=131394) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 17 23:43:59.461812 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-81dcc9af-4851-4c08-9d09-d83961678589 req-6c990b89-df37-44bd-93bc-f20ae90c74da service nova] Acquired lock "compute-rpcapi-router" {{(pid=131394) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 17 23:43:59.462829 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bf427969-1154-4246-a109-b01d86c39690 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:59.463286 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bf427969-1154-4246-a109-b01d86c39690 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:59.464448 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bf427969-1154-4246-a109-b01d86c39690 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:59.465336 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bf427969-1154-4246-a109-b01d86c39690 None None] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:59.465786 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bf427969-1154-4246-a109-b01d86c39690 None None] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:59.466201 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bf427969-1154-4246-a109-b01d86c39690 None None] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:59.475847 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.compute.rpcapi [None req-bf427969-1154-4246-a109-b01d86c39690 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 17 23:43:59.477005 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bf427969-1154-4246-a109-b01d86c39690 None None] Releasing lock "compute-rpcapi-router" {{(pid=131394) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 17 23:43:59.498095 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-bf427969-1154-4246-a109-b01d86c39690 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147208 Aug 17 23:43:59.499048 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 60/116] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:43:59.505084 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a04169e8-c453-422b-af2a-e8610a18e2c4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:43:59.506031 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a04169e8-c453-422b-af2a-e8610a18e2c4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:43:59.513444 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a04169e8-c453-422b-af2a-e8610a18e2c4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:59.514141 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a04169e8-c453-422b-af2a-e8610a18e2c4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:59.514579 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a04169e8-c453-422b-af2a-e8610a18e2c4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:59.515532 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a04169e8-c453-422b-af2a-e8610a18e2c4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:59.516144 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a04169e8-c453-422b-af2a-e8610a18e2c4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:59.516498 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a04169e8-c453-422b-af2a-e8610a18e2c4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:59.640211 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a04169e8-c453-422b-af2a-e8610a18e2c4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:59.652812 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a04169e8-c453-422b-af2a-e8610a18e2c4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:59.655373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a04169e8-c453-422b-af2a-e8610a18e2c4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:59.657001 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a04169e8-c453-422b-af2a-e8610a18e2c4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1339 microversion: 2.20 time: 0.156643 Aug 17 23:43:59.658838 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 61/117] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:43:59 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1339 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:43:59.798239 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-6cc9cc3f-2200-4251-8f9f-cfdb1a32a931 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:43:59.818998 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-6cc9cc3f-2200-4251-8f9f-cfdb1a32a931 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.624219 Aug 17 23:43:59.827918 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 57/118] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:43:59 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:43:59.879735 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-d94b592a-722c-4266-b561-f6d43cec36b4 req-486fba4b-9aa7-4135-8d77-6a8a4365808e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c46dee0-bdd3-468a-ad6d-52a9f50e8210", "tag": "021b5852-09eb-4120-9100-b585b3d1065b"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:43:59.890603 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-d94b592a-722c-4266-b561-f6d43cec36b4 req-486fba4b-9aa7-4135-8d77-6a8a4365808e service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:43:59.891488 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-d94b592a-722c-4266-b561-f6d43cec36b4 req-486fba4b-9aa7-4135-8d77-6a8a4365808e service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:43:59.892179 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-d94b592a-722c-4266-b561-f6d43cec36b4 req-486fba4b-9aa7-4135-8d77-6a8a4365808e service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:43:59.905772 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-d94b592a-722c-4266-b561-f6d43cec36b4 req-486fba4b-9aa7-4135-8d77-6a8a4365808e service nova] Creating event network-changed:021b5852-09eb-4120-9100-b585b3d1065b for instance 8c46dee0-bdd3-468a-ad6d-52a9f50e8210 on hv-cinder-82002 Aug 17 23:43:59.911137 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-d94b592a-722c-4266-b561-f6d43cec36b4 req-486fba4b-9aa7-4135-8d77-6a8a4365808e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102803 Aug 17 23:43:59.912334 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 62/119] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:44:00.193576 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-09a82d5d-4d11-462a-a74e-1bca8a788eab tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:00.194200 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-09a82d5d-4d11-462a-a74e-1bca8a788eab tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:00.207181 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-09a82d5d-4d11-462a-a74e-1bca8a788eab tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:00.207181 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-09a82d5d-4d11-462a-a74e-1bca8a788eab tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:00.207181 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-09a82d5d-4d11-462a-a74e-1bca8a788eab tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:00.207904 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-09a82d5d-4d11-462a-a74e-1bca8a788eab tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:00.209227 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-09a82d5d-4d11-462a-a74e-1bca8a788eab tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:00.210838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-09a82d5d-4d11-462a-a74e-1bca8a788eab tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:00.374500 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8b85dfe2-3948-4b5d-acff-64003bd328a2 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:00.376836 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8b85dfe2-3948-4b5d-acff-64003bd328a2 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:00.415489 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8b85dfe2-3948-4b5d-acff-64003bd328a2 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:00.418020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8b85dfe2-3948-4b5d-acff-64003bd328a2 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:00.418686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8b85dfe2-3948-4b5d-acff-64003bd328a2 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:00.419489 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8b85dfe2-3948-4b5d-acff-64003bd328a2 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:00.419912 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8b85dfe2-3948-4b5d-acff-64003bd328a2 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:00.426072 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8b85dfe2-3948-4b5d-acff-64003bd328a2 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:00.550720 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-09a82d5d-4d11-462a-a74e-1bca8a788eab tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:00.561572 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-09a82d5d-4d11-462a-a74e-1bca8a788eab tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.372093 Aug 17 23:44:00.562641 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 58/120] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:00 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:00.662263 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-8b85dfe2-3948-4b5d-acff-64003bd328a2 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:00.670632 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8b85dfe2-3948-4b5d-acff-64003bd328a2 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.305008 Aug 17 23:44:00.671334 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 63/121] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:00 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:00.681331 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-656cbe36-0be9-488a-ac4a-ed5f83ad7b5a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:00.682202 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-656cbe36-0be9-488a-ac4a-ed5f83ad7b5a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:00.693522 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-656cbe36-0be9-488a-ac4a-ed5f83ad7b5a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:00.694622 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-656cbe36-0be9-488a-ac4a-ed5f83ad7b5a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:00.695271 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-656cbe36-0be9-488a-ac4a-ed5f83ad7b5a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:00.696675 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-656cbe36-0be9-488a-ac4a-ed5f83ad7b5a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:00.698158 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-656cbe36-0be9-488a-ac4a-ed5f83ad7b5a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:00.698761 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-656cbe36-0be9-488a-ac4a-ed5f83ad7b5a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:00.841460 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-656cbe36-0be9-488a-ac4a-ed5f83ad7b5a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:00.847545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f2aa6a57-9ad5-4d73-8a54-d50afa16c638 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:00.849184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f2aa6a57-9ad5-4d73-8a54-d50afa16c638 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:00.849840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-656cbe36-0be9-488a-ac4a-ed5f83ad7b5a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:00.851585 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-656cbe36-0be9-488a-ac4a-ed5f83ad7b5a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:00.853002 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-656cbe36-0be9-488a-ac4a-ed5f83ad7b5a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.175860 Aug 17 23:44:00.854755 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 59/122] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:00 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:00.858695 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2aa6a57-9ad5-4d73-8a54-d50afa16c638 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:00.859418 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2aa6a57-9ad5-4d73-8a54-d50afa16c638 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:00.860057 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2aa6a57-9ad5-4d73-8a54-d50afa16c638 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:00.861212 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2aa6a57-9ad5-4d73-8a54-d50afa16c638 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:00.861866 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2aa6a57-9ad5-4d73-8a54-d50afa16c638 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:00.862561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2aa6a57-9ad5-4d73-8a54-d50afa16c638 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:01.050755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f2aa6a57-9ad5-4d73-8a54-d50afa16c638 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:01.058136 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f2aa6a57-9ad5-4d73-8a54-d50afa16c638 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.215095 Aug 17 23:44:01.058831 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 64/123] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:00 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:01.594138 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-afea1074-c8a9-435a-99b2-c08d68c063b2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:01.594755 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-afea1074-c8a9-435a-99b2-c08d68c063b2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:01.600688 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-afea1074-c8a9-435a-99b2-c08d68c063b2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:01.601176 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-afea1074-c8a9-435a-99b2-c08d68c063b2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:01.601616 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-afea1074-c8a9-435a-99b2-c08d68c063b2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:01.602303 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-afea1074-c8a9-435a-99b2-c08d68c063b2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:01.602767 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-afea1074-c8a9-435a-99b2-c08d68c063b2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:01.603193 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-afea1074-c8a9-435a-99b2-c08d68c063b2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:01.694726 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ea512cb2-2595-4633-884c-fa90a02d2c16 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:01.695346 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ea512cb2-2595-4633-884c-fa90a02d2c16 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:01.701666 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ea512cb2-2595-4633-884c-fa90a02d2c16 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:01.702156 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ea512cb2-2595-4633-884c-fa90a02d2c16 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:01.702759 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ea512cb2-2595-4633-884c-fa90a02d2c16 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:01.703455 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ea512cb2-2595-4633-884c-fa90a02d2c16 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:01.703911 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ea512cb2-2595-4633-884c-fa90a02d2c16 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:01.704358 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ea512cb2-2595-4633-884c-fa90a02d2c16 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:01.738897 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-afea1074-c8a9-435a-99b2-c08d68c063b2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:01.750383 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-afea1074-c8a9-435a-99b2-c08d68c063b2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.160028 Aug 17 23:44:01.750958 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 60/124] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:01 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:01.843577 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ea512cb2-2595-4633-884c-fa90a02d2c16 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:01.851029 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ea512cb2-2595-4633-884c-fa90a02d2c16 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.160229 Aug 17 23:44:01.851599 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 65/125] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:01 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:01.875992 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-bb35e013-a340-44cd-836f-383ed013b0c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:01.876627 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-bb35e013-a340-44cd-836f-383ed013b0c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:01.882722 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bb35e013-a340-44cd-836f-383ed013b0c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:01.883204 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bb35e013-a340-44cd-836f-383ed013b0c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:01.883634 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bb35e013-a340-44cd-836f-383ed013b0c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:01.884339 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bb35e013-a340-44cd-836f-383ed013b0c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:01.884788 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bb35e013-a340-44cd-836f-383ed013b0c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:01.885754 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bb35e013-a340-44cd-836f-383ed013b0c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:01.940199 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-2b28439e-e191-4a99-b889-e442864eb43c req-be41e4c3-295b-40f2-981f-a72979e36569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "259ce9fa-eddc-4fe4-8789-9a13bff9ca86", "tag": "80b1223e-6f35-4bf9-b8d0-8d3eb6f8eccc"}, {"name": "network-changed", "server_uuid": "ad01f85b-96a2-474a-85f3-7f7c1fd43db7", "tag": "8941515b-b419-450f-837f-9dd12af4a0c2"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:44:01.949261 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-2b28439e-e191-4a99-b889-e442864eb43c req-be41e4c3-295b-40f2-981f-a72979e36569 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:01.949734 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-2b28439e-e191-4a99-b889-e442864eb43c req-be41e4c3-295b-40f2-981f-a72979e36569 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:01.950159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-2b28439e-e191-4a99-b889-e442864eb43c req-be41e4c3-295b-40f2-981f-a72979e36569 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:01.962503 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-2b28439e-e191-4a99-b889-e442864eb43c req-be41e4c3-295b-40f2-981f-a72979e36569 service nova] Creating event network-changed:80b1223e-6f35-4bf9-b8d0-8d3eb6f8eccc for instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 on hv-cinder-82002 Aug 17 23:44:01.963287 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-2b28439e-e191-4a99-b889-e442864eb43c req-be41e4c3-295b-40f2-981f-a72979e36569 service nova] Creating event network-changed:8941515b-b419-450f-837f-9dd12af4a0c2 for instance ad01f85b-96a2-474a-85f3-7f7c1fd43db7 on hv-cinder-82002 Aug 17 23:44:01.970205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-2b28439e-e191-4a99-b889-e442864eb43c req-be41e4c3-295b-40f2-981f-a72979e36569 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035963 Aug 17 23:44:01.970795 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 66/126] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:44:02.027549 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-bb35e013-a340-44cd-836f-383ed013b0c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:02.035710 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-bb35e013-a340-44cd-836f-383ed013b0c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:02.037234 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-bb35e013-a340-44cd-836f-383ed013b0c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:02.038337 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-bb35e013-a340-44cd-836f-383ed013b0c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.166182 Aug 17 23:44:02.038887 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 61/127] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:01 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:02.080412 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-6d629cd7-21fc-4ffc-a537-04154b4b208a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:02.081110 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-6d629cd7-21fc-4ffc-a537-04154b4b208a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:02.087107 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6d629cd7-21fc-4ffc-a537-04154b4b208a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:02.087589 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6d629cd7-21fc-4ffc-a537-04154b4b208a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:02.088055 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6d629cd7-21fc-4ffc-a537-04154b4b208a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:02.088773 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6d629cd7-21fc-4ffc-a537-04154b4b208a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:02.089344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6d629cd7-21fc-4ffc-a537-04154b4b208a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:02.089858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6d629cd7-21fc-4ffc-a537-04154b4b208a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:02.225653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-6d629cd7-21fc-4ffc-a537-04154b4b208a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:02.233959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-6d629cd7-21fc-4ffc-a537-04154b4b208a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.158270 Aug 17 23:44:02.234614 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 67/128] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:02 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:02.770641 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-715a561a-0259-4f32-a1d6-5cff6bcedade tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:02.771302 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-715a561a-0259-4f32-a1d6-5cff6bcedade tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:02.777375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-715a561a-0259-4f32-a1d6-5cff6bcedade tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:02.777854 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-715a561a-0259-4f32-a1d6-5cff6bcedade tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:02.778452 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-715a561a-0259-4f32-a1d6-5cff6bcedade tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:02.779171 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-715a561a-0259-4f32-a1d6-5cff6bcedade tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:02.779592 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-715a561a-0259-4f32-a1d6-5cff6bcedade tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:02.780035 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-715a561a-0259-4f32-a1d6-5cff6bcedade tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:02.873743 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-7aa3f023-450b-4201-b84c-97c24a8105fc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:02.874358 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-7aa3f023-450b-4201-b84c-97c24a8105fc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:02.881155 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7aa3f023-450b-4201-b84c-97c24a8105fc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:02.881991 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7aa3f023-450b-4201-b84c-97c24a8105fc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:02.882661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7aa3f023-450b-4201-b84c-97c24a8105fc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:02.883679 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7aa3f023-450b-4201-b84c-97c24a8105fc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:02.884421 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7aa3f023-450b-4201-b84c-97c24a8105fc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:02.885074 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7aa3f023-450b-4201-b84c-97c24a8105fc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:02.925836 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-715a561a-0259-4f32-a1d6-5cff6bcedade tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:02.934224 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-715a561a-0259-4f32-a1d6-5cff6bcedade tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.167408 Aug 17 23:44:02.938864 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 62/129] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:02 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:03.038375 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-7aa3f023-450b-4201-b84c-97c24a8105fc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:03.045723 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-7aa3f023-450b-4201-b84c-97c24a8105fc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.176242 Aug 17 23:44:03.046281 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 68/130] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:02 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:03.061597 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b79c81fb-a9b3-4932-bf9b-c51aee1c5e29 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:03.062315 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b79c81fb-a9b3-4932-bf9b-c51aee1c5e29 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:03.068269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b79c81fb-a9b3-4932-bf9b-c51aee1c5e29 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:03.068808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b79c81fb-a9b3-4932-bf9b-c51aee1c5e29 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:03.069248 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b79c81fb-a9b3-4932-bf9b-c51aee1c5e29 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:03.069931 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b79c81fb-a9b3-4932-bf9b-c51aee1c5e29 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:03.070385 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b79c81fb-a9b3-4932-bf9b-c51aee1c5e29 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:03.070805 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b79c81fb-a9b3-4932-bf9b-c51aee1c5e29 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:03.206244 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b79c81fb-a9b3-4932-bf9b-c51aee1c5e29 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:03.214697 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b79c81fb-a9b3-4932-bf9b-c51aee1c5e29 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:03.216331 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b79c81fb-a9b3-4932-bf9b-c51aee1c5e29 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:03.217495 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b79c81fb-a9b3-4932-bf9b-c51aee1c5e29 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.160310 Aug 17 23:44:03.218217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 63/131] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:03 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:03.254848 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-50be0537-131b-4be5-b26d-736d48e93ad3 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:03.255466 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-50be0537-131b-4be5-b26d-736d48e93ad3 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:03.261780 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-50be0537-131b-4be5-b26d-736d48e93ad3 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:03.262262 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-50be0537-131b-4be5-b26d-736d48e93ad3 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:03.262878 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-50be0537-131b-4be5-b26d-736d48e93ad3 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:03.263929 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-50be0537-131b-4be5-b26d-736d48e93ad3 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:03.264419 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-50be0537-131b-4be5-b26d-736d48e93ad3 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:03.265002 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-50be0537-131b-4be5-b26d-736d48e93ad3 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:03.269223 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=100 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:44:03.404833 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-50be0537-131b-4be5-b26d-736d48e93ad3 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:03.415364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-50be0537-131b-4be5-b26d-736d48e93ad3 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.164209 Aug 17 23:44:03.416416 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 69/132] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:03 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:03.954518 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-dd2a7780-26eb-4584-9e27-41cc38d47675 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:03.955380 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-dd2a7780-26eb-4584-9e27-41cc38d47675 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:03.961948 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dd2a7780-26eb-4584-9e27-41cc38d47675 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:03.962592 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dd2a7780-26eb-4584-9e27-41cc38d47675 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:03.963038 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dd2a7780-26eb-4584-9e27-41cc38d47675 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:03.963769 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dd2a7780-26eb-4584-9e27-41cc38d47675 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:03.964265 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dd2a7780-26eb-4584-9e27-41cc38d47675 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:03.964697 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dd2a7780-26eb-4584-9e27-41cc38d47675 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:04.066434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d5b3a728-1534-4a30-8cd9-3ffb615a7fc0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:04.067765 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d5b3a728-1534-4a30-8cd9-3ffb615a7fc0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:04.073525 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5b3a728-1534-4a30-8cd9-3ffb615a7fc0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:04.074005 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5b3a728-1534-4a30-8cd9-3ffb615a7fc0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:04.074434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5b3a728-1534-4a30-8cd9-3ffb615a7fc0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:04.075117 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5b3a728-1534-4a30-8cd9-3ffb615a7fc0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:04.075566 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5b3a728-1534-4a30-8cd9-3ffb615a7fc0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:04.076006 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5b3a728-1534-4a30-8cd9-3ffb615a7fc0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:04.102668 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-dd2a7780-26eb-4584-9e27-41cc38d47675 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:04.111797 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-dd2a7780-26eb-4584-9e27-41cc38d47675 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.161284 Aug 17 23:44:04.112429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 64/133] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:03 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:04.240074 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b74051da-e752-417c-b109-c1e44a076c97 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:04.240720 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b74051da-e752-417c-b109-c1e44a076c97 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:04.246603 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b74051da-e752-417c-b109-c1e44a076c97 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:04.247089 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b74051da-e752-417c-b109-c1e44a076c97 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:04.247525 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b74051da-e752-417c-b109-c1e44a076c97 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:04.248425 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b74051da-e752-417c-b109-c1e44a076c97 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:04.248883 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b74051da-e752-417c-b109-c1e44a076c97 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:04.249311 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b74051da-e752-417c-b109-c1e44a076c97 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:04.261781 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d5b3a728-1534-4a30-8cd9-3ffb615a7fc0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:04.270101 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d5b3a728-1534-4a30-8cd9-3ffb615a7fc0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.206876 Aug 17 23:44:04.270812 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 70/134] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:04 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:04.393113 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b74051da-e752-417c-b109-c1e44a076c97 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:04.402661 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b74051da-e752-417c-b109-c1e44a076c97 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:04.404419 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b74051da-e752-417c-b109-c1e44a076c97 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:04.405722 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b74051da-e752-417c-b109-c1e44a076c97 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.169483 Aug 17 23:44:04.406325 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 65/135] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:04 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:44:04.437317 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-4ceccf14-9545-4525-b0cc-5dfdb8996942 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:04.438318 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-4ceccf14-9545-4525-b0cc-5dfdb8996942 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:04.445654 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4ceccf14-9545-4525-b0cc-5dfdb8996942 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:04.446152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4ceccf14-9545-4525-b0cc-5dfdb8996942 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:04.446593 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4ceccf14-9545-4525-b0cc-5dfdb8996942 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:04.447404 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4ceccf14-9545-4525-b0cc-5dfdb8996942 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:04.448471 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4ceccf14-9545-4525-b0cc-5dfdb8996942 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:04.449106 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4ceccf14-9545-4525-b0cc-5dfdb8996942 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:04.587237 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-4ceccf14-9545-4525-b0cc-5dfdb8996942 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:04.595758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-4ceccf14-9545-4525-b0cc-5dfdb8996942 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.162566 Aug 17 23:44:04.596724 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 71/136] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:04 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:05.133355 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a1dcf4d5-1ff0-453c-9c70-04c0f39df371 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:05.133995 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a1dcf4d5-1ff0-453c-9c70-04c0f39df371 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:05.140428 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a1dcf4d5-1ff0-453c-9c70-04c0f39df371 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:05.140903 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a1dcf4d5-1ff0-453c-9c70-04c0f39df371 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:05.141335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a1dcf4d5-1ff0-453c-9c70-04c0f39df371 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:05.142197 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a1dcf4d5-1ff0-453c-9c70-04c0f39df371 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:05.142738 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a1dcf4d5-1ff0-453c-9c70-04c0f39df371 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:05.143160 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a1dcf4d5-1ff0-453c-9c70-04c0f39df371 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:05.275280 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a1dcf4d5-1ff0-453c-9c70-04c0f39df371 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:05.283021 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a1dcf4d5-1ff0-453c-9c70-04c0f39df371 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.153395 Aug 17 23:44:05.283756 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 66/137] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:05 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:05.295774 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9b070237-9d2d-4a63-a748-a326eb6a867f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:05.296628 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9b070237-9d2d-4a63-a748-a326eb6a867f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:05.302722 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9b070237-9d2d-4a63-a748-a326eb6a867f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:05.303316 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9b070237-9d2d-4a63-a748-a326eb6a867f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:05.303826 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9b070237-9d2d-4a63-a748-a326eb6a867f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:05.304616 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9b070237-9d2d-4a63-a748-a326eb6a867f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:05.305144 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9b070237-9d2d-4a63-a748-a326eb6a867f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:05.305640 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9b070237-9d2d-4a63-a748-a326eb6a867f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:05.431451 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-34f7799b-031a-4d47-80e4-4ee4772333ce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:05.432210 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-34f7799b-031a-4d47-80e4-4ee4772333ce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:05.440603 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-34f7799b-031a-4d47-80e4-4ee4772333ce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:05.441389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-34f7799b-031a-4d47-80e4-4ee4772333ce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:05.441948 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-34f7799b-031a-4d47-80e4-4ee4772333ce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:05.442770 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-34f7799b-031a-4d47-80e4-4ee4772333ce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:05.443499 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-34f7799b-031a-4d47-80e4-4ee4772333ce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:05.444091 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-34f7799b-031a-4d47-80e4-4ee4772333ce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:05.558696 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9b070237-9d2d-4a63-a748-a326eb6a867f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:05.569600 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9b070237-9d2d-4a63-a748-a326eb6a867f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.279891 Aug 17 23:44:05.570173 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 72/138] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:05 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:05.618775 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-67d62a45-adb3-434b-8b1e-6507f4b69c2b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:05.619709 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-67d62a45-adb3-434b-8b1e-6507f4b69c2b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:05.620448 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-34f7799b-031a-4d47-80e4-4ee4772333ce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:05.629776 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-67d62a45-adb3-434b-8b1e-6507f4b69c2b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:05.630300 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-34f7799b-031a-4d47-80e4-4ee4772333ce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:05.630577 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-67d62a45-adb3-434b-8b1e-6507f4b69c2b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:05.631079 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-67d62a45-adb3-434b-8b1e-6507f4b69c2b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:05.631884 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-67d62a45-adb3-434b-8b1e-6507f4b69c2b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:05.632371 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-34f7799b-031a-4d47-80e4-4ee4772333ce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:05.632505 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-67d62a45-adb3-434b-8b1e-6507f4b69c2b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:05.632849 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-67d62a45-adb3-434b-8b1e-6507f4b69c2b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:05.633750 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-34f7799b-031a-4d47-80e4-4ee4772333ce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.207260 Aug 17 23:44:05.634734 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 67/139] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:05 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:44:05.819497 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-67d62a45-adb3-434b-8b1e-6507f4b69c2b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:05.827730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-67d62a45-adb3-434b-8b1e-6507f4b69c2b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.214051 Aug 17 23:44:05.828329 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 73/140] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:05 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:06.304524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-8f1b5024-b594-4ea6-a594-fcd0eb69a8f9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:06.305691 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-8f1b5024-b594-4ea6-a594-fcd0eb69a8f9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:06.312386 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8f1b5024-b594-4ea6-a594-fcd0eb69a8f9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:06.312864 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8f1b5024-b594-4ea6-a594-fcd0eb69a8f9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:06.313298 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8f1b5024-b594-4ea6-a594-fcd0eb69a8f9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:06.313998 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8f1b5024-b594-4ea6-a594-fcd0eb69a8f9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:06.314449 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8f1b5024-b594-4ea6-a594-fcd0eb69a8f9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:06.314867 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8f1b5024-b594-4ea6-a594-fcd0eb69a8f9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:06.477494 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8f1b5024-b594-4ea6-a594-fcd0eb69a8f9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:06.486654 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-8f1b5024-b594-4ea6-a594-fcd0eb69a8f9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.185882 Aug 17 23:44:06.487467 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 68/141] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:06 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:06.591743 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9f43983c-bb5d-4356-a0fd-948c3e381166 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:06.600778 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9f43983c-bb5d-4356-a0fd-948c3e381166 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:06.618477 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f43983c-bb5d-4356-a0fd-948c3e381166 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:06.624684 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f43983c-bb5d-4356-a0fd-948c3e381166 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:06.625372 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f43983c-bb5d-4356-a0fd-948c3e381166 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:06.626311 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f43983c-bb5d-4356-a0fd-948c3e381166 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:06.627157 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f43983c-bb5d-4356-a0fd-948c3e381166 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:06.628069 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f43983c-bb5d-4356-a0fd-948c3e381166 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:06.657826 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a65fe6a6-bbc0-4d28-ac6b-90ea3441da43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:06.658666 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a65fe6a6-bbc0-4d28-ac6b-90ea3441da43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:06.671431 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a65fe6a6-bbc0-4d28-ac6b-90ea3441da43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:06.671937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a65fe6a6-bbc0-4d28-ac6b-90ea3441da43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:06.672407 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a65fe6a6-bbc0-4d28-ac6b-90ea3441da43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:06.677370 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a65fe6a6-bbc0-4d28-ac6b-90ea3441da43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:06.678578 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a65fe6a6-bbc0-4d28-ac6b-90ea3441da43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:06.680233 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a65fe6a6-bbc0-4d28-ac6b-90ea3441da43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:06.847698 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a65fe6a6-bbc0-4d28-ac6b-90ea3441da43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:06.859693 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a65fe6a6-bbc0-4d28-ac6b-90ea3441da43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:06.862240 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a65fe6a6-bbc0-4d28-ac6b-90ea3441da43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:06.864076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a65fe6a6-bbc0-4d28-ac6b-90ea3441da43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.209533 Aug 17 23:44:06.877710 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 69/142] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:06 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:06.895650 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0f029e17-836a-4dcb-8901-5073f1fd4757 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:06.896534 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0f029e17-836a-4dcb-8901-5073f1fd4757 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:06.903681 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0f029e17-836a-4dcb-8901-5073f1fd4757 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:06.904224 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0f029e17-836a-4dcb-8901-5073f1fd4757 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:06.904656 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0f029e17-836a-4dcb-8901-5073f1fd4757 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:06.905520 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0f029e17-836a-4dcb-8901-5073f1fd4757 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:06.906111 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0f029e17-836a-4dcb-8901-5073f1fd4757 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:06.906584 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0f029e17-836a-4dcb-8901-5073f1fd4757 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:06.942432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9f43983c-bb5d-4356-a0fd-948c3e381166 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:06.950684 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9f43983c-bb5d-4356-a0fd-948c3e381166 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.363793 Aug 17 23:44:06.951470 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 74/143] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:06 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:07.063997 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0f029e17-836a-4dcb-8901-5073f1fd4757 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:07.073146 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0f029e17-836a-4dcb-8901-5073f1fd4757 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.193391 Aug 17 23:44:07.074115 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 70/144] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:06 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:07.508641 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-68fd7717-c0a3-48f9-b993-fab6949ec2a4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:07.511997 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-68fd7717-c0a3-48f9-b993-fab6949ec2a4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:07.519651 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-68fd7717-c0a3-48f9-b993-fab6949ec2a4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:07.520292 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-68fd7717-c0a3-48f9-b993-fab6949ec2a4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:07.521731 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-68fd7717-c0a3-48f9-b993-fab6949ec2a4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:07.522725 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-68fd7717-c0a3-48f9-b993-fab6949ec2a4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:07.523453 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-68fd7717-c0a3-48f9-b993-fab6949ec2a4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:07.524155 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-68fd7717-c0a3-48f9-b993-fab6949ec2a4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:07.718919 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-68fd7717-c0a3-48f9-b993-fab6949ec2a4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:07.727214 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-68fd7717-c0a3-48f9-b993-fab6949ec2a4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.222368 Aug 17 23:44:07.741700 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 75/145] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:07 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:07.901367 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5f153037-aac3-4c25-a613-2e5febb74e70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:07.901901 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5f153037-aac3-4c25-a613-2e5febb74e70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:07.908539 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5f153037-aac3-4c25-a613-2e5febb74e70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:07.909268 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5f153037-aac3-4c25-a613-2e5febb74e70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:07.910177 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5f153037-aac3-4c25-a613-2e5febb74e70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:07.911073 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5f153037-aac3-4c25-a613-2e5febb74e70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:07.911539 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5f153037-aac3-4c25-a613-2e5febb74e70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:07.911977 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5f153037-aac3-4c25-a613-2e5febb74e70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:07.974665 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f012ff96-6a51-4446-980e-dedf580dd4e6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:07.976253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f012ff96-6a51-4446-980e-dedf580dd4e6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:07.984827 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f012ff96-6a51-4446-980e-dedf580dd4e6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:07.985530 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f012ff96-6a51-4446-980e-dedf580dd4e6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:07.986111 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f012ff96-6a51-4446-980e-dedf580dd4e6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:07.986949 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f012ff96-6a51-4446-980e-dedf580dd4e6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:07.987546 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f012ff96-6a51-4446-980e-dedf580dd4e6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:07.988147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f012ff96-6a51-4446-980e-dedf580dd4e6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:08.076384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5f153037-aac3-4c25-a613-2e5febb74e70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:08.091921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5f153037-aac3-4c25-a613-2e5febb74e70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:08.093552 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5f153037-aac3-4c25-a613-2e5febb74e70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:08.094768 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5f153037-aac3-4c25-a613-2e5febb74e70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.198014 Aug 17 23:44:08.095409 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 71/146] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:07 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:08.109477 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ec8d40ec-2407-4fbe-8cd3-3689486aecea tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:08.110172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ec8d40ec-2407-4fbe-8cd3-3689486aecea tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:08.116275 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ec8d40ec-2407-4fbe-8cd3-3689486aecea tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:08.116856 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ec8d40ec-2407-4fbe-8cd3-3689486aecea tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:08.117355 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ec8d40ec-2407-4fbe-8cd3-3689486aecea tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:08.118213 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ec8d40ec-2407-4fbe-8cd3-3689486aecea tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:08.118812 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ec8d40ec-2407-4fbe-8cd3-3689486aecea tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:08.119080 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ec8d40ec-2407-4fbe-8cd3-3689486aecea tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:08.197492 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f012ff96-6a51-4446-980e-dedf580dd4e6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:08.207683 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f012ff96-6a51-4446-980e-dedf580dd4e6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.238654 Aug 17 23:44:08.208753 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 76/147] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:07 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:08.311220 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ec8d40ec-2407-4fbe-8cd3-3689486aecea tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:08.319380 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ec8d40ec-2407-4fbe-8cd3-3689486aecea tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.222657 Aug 17 23:44:08.320064 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 72/148] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:08 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:08.749143 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a1e1f015-87c9-4f82-9ad7-d34a1f6e3381 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:08.749766 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a1e1f015-87c9-4f82-9ad7-d34a1f6e3381 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:08.755724 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1e1f015-87c9-4f82-9ad7-d34a1f6e3381 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:08.756282 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1e1f015-87c9-4f82-9ad7-d34a1f6e3381 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:08.756725 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1e1f015-87c9-4f82-9ad7-d34a1f6e3381 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:08.757412 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1e1f015-87c9-4f82-9ad7-d34a1f6e3381 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:08.757871 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1e1f015-87c9-4f82-9ad7-d34a1f6e3381 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:08.758299 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1e1f015-87c9-4f82-9ad7-d34a1f6e3381 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:08.890991 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a1e1f015-87c9-4f82-9ad7-d34a1f6e3381 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:08.898421 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a1e1f015-87c9-4f82-9ad7-d34a1f6e3381 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.153109 Aug 17 23:44:08.898993 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 77/149] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:08 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:09.117425 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-fc4c24a3-6a81-4c4b-a8ee-4832c202b2bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:09.118389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-fc4c24a3-6a81-4c4b-a8ee-4832c202b2bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:09.124539 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fc4c24a3-6a81-4c4b-a8ee-4832c202b2bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:09.125162 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fc4c24a3-6a81-4c4b-a8ee-4832c202b2bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:09.125685 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fc4c24a3-6a81-4c4b-a8ee-4832c202b2bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:09.126447 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fc4c24a3-6a81-4c4b-a8ee-4832c202b2bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:09.126978 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fc4c24a3-6a81-4c4b-a8ee-4832c202b2bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:09.127464 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fc4c24a3-6a81-4c4b-a8ee-4832c202b2bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:09.147339 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=100 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:44:09.231576 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c7e54da2-18d3-4b59-b689-1b16dd63a1c2 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:09.232209 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c7e54da2-18d3-4b59-b689-1b16dd63a1c2 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:09.238743 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c7e54da2-18d3-4b59-b689-1b16dd63a1c2 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:09.239535 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c7e54da2-18d3-4b59-b689-1b16dd63a1c2 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:09.240225 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c7e54da2-18d3-4b59-b689-1b16dd63a1c2 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:09.241118 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c7e54da2-18d3-4b59-b689-1b16dd63a1c2 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:09.241768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c7e54da2-18d3-4b59-b689-1b16dd63a1c2 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:09.242474 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c7e54da2-18d3-4b59-b689-1b16dd63a1c2 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:09.281125 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-fc4c24a3-6a81-4c4b-a8ee-4832c202b2bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:09.290922 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-fc4c24a3-6a81-4c4b-a8ee-4832c202b2bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:09.293217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-fc4c24a3-6a81-4c4b-a8ee-4832c202b2bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:09.294609 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-fc4c24a3-6a81-4c4b-a8ee-4832c202b2bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.181043 Aug 17 23:44:09.295241 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 73/150] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:09 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:09.342962 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-bdf21f3b-8135-468e-bc72-ca1cf83d9e57 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:09.343703 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-bdf21f3b-8135-468e-bc72-ca1cf83d9e57 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:09.350433 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bdf21f3b-8135-468e-bc72-ca1cf83d9e57 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:09.350929 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bdf21f3b-8135-468e-bc72-ca1cf83d9e57 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:09.351363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bdf21f3b-8135-468e-bc72-ca1cf83d9e57 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:09.352247 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bdf21f3b-8135-468e-bc72-ca1cf83d9e57 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:09.352704 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bdf21f3b-8135-468e-bc72-ca1cf83d9e57 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:09.353128 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bdf21f3b-8135-468e-bc72-ca1cf83d9e57 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:09.392594 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c7e54da2-18d3-4b59-b689-1b16dd63a1c2 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:09.403885 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c7e54da2-18d3-4b59-b689-1b16dd63a1c2 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.176126 Aug 17 23:44:09.404631 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 78/151] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:09 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:09.486853 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-bdf21f3b-8135-468e-bc72-ca1cf83d9e57 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:09.495300 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-bdf21f3b-8135-468e-bc72-ca1cf83d9e57 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.158388 Aug 17 23:44:09.495873 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 74/152] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:09 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:09.919493 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1852e195-e609-483d-adc9-08b75c53e577 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:09.920144 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1852e195-e609-483d-adc9-08b75c53e577 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:09.921971 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=2 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:44:09.927282 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1852e195-e609-483d-adc9-08b75c53e577 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:09.927774 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1852e195-e609-483d-adc9-08b75c53e577 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:09.928244 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1852e195-e609-483d-adc9-08b75c53e577 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:09.928930 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1852e195-e609-483d-adc9-08b75c53e577 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:09.929391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1852e195-e609-483d-adc9-08b75c53e577 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:09.929819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1852e195-e609-483d-adc9-08b75c53e577 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:10.059194 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1852e195-e609-483d-adc9-08b75c53e577 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:10.066570 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1852e195-e609-483d-adc9-08b75c53e577 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.151064 Aug 17 23:44:10.067128 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 79/153] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:09 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:10.317438 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a52a72ab-2b94-4f6b-aeae-168e28b93215 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:10.317971 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a52a72ab-2b94-4f6b-aeae-168e28b93215 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:10.324476 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a52a72ab-2b94-4f6b-aeae-168e28b93215 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:10.324971 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a52a72ab-2b94-4f6b-aeae-168e28b93215 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:10.325487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a52a72ab-2b94-4f6b-aeae-168e28b93215 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:10.326169 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a52a72ab-2b94-4f6b-aeae-168e28b93215 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:10.326621 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a52a72ab-2b94-4f6b-aeae-168e28b93215 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:10.327040 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a52a72ab-2b94-4f6b-aeae-168e28b93215 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:10.430161 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-72ae9861-e354-4880-a75c-835f1ebfb3ba tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:10.430773 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-72ae9861-e354-4880-a75c-835f1ebfb3ba tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:10.437079 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-72ae9861-e354-4880-a75c-835f1ebfb3ba tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:10.437559 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-72ae9861-e354-4880-a75c-835f1ebfb3ba tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:10.437994 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-72ae9861-e354-4880-a75c-835f1ebfb3ba tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:10.438676 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-72ae9861-e354-4880-a75c-835f1ebfb3ba tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:10.439129 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-72ae9861-e354-4880-a75c-835f1ebfb3ba tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:10.439555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-72ae9861-e354-4880-a75c-835f1ebfb3ba tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:10.462275 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a52a72ab-2b94-4f6b-aeae-168e28b93215 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:10.470495 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a52a72ab-2b94-4f6b-aeae-168e28b93215 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:10.472028 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a52a72ab-2b94-4f6b-aeae-168e28b93215 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:10.473136 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a52a72ab-2b94-4f6b-aeae-168e28b93215 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.159693 Aug 17 23:44:10.473841 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 75/154] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:10 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:10.516172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-d47a5b46-9e9d-46cb-bbdc-6074e777c568 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:10.516787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-d47a5b46-9e9d-46cb-bbdc-6074e777c568 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:10.522793 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d47a5b46-9e9d-46cb-bbdc-6074e777c568 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:10.523376 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d47a5b46-9e9d-46cb-bbdc-6074e777c568 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:10.523870 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d47a5b46-9e9d-46cb-bbdc-6074e777c568 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:10.524640 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d47a5b46-9e9d-46cb-bbdc-6074e777c568 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:10.525153 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d47a5b46-9e9d-46cb-bbdc-6074e777c568 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:10.525673 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d47a5b46-9e9d-46cb-bbdc-6074e777c568 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:10.568798 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-72ae9861-e354-4880-a75c-835f1ebfb3ba tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:10.576823 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-72ae9861-e354-4880-a75c-835f1ebfb3ba tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.150479 Aug 17 23:44:10.577391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 80/155] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:10 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:10.654392 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d47a5b46-9e9d-46cb-bbdc-6074e777c568 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:10.662117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-d47a5b46-9e9d-46cb-bbdc-6074e777c568 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.149744 Aug 17 23:44:10.662864 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 76/156] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:10 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:11.087266 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a75dc1b2-e140-4482-b099-09e0bfceff41 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:11.087887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a75dc1b2-e140-4482-b099-09e0bfceff41 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:11.093758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a75dc1b2-e140-4482-b099-09e0bfceff41 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:11.094261 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a75dc1b2-e140-4482-b099-09e0bfceff41 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:11.094702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a75dc1b2-e140-4482-b099-09e0bfceff41 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:11.095388 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a75dc1b2-e140-4482-b099-09e0bfceff41 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:11.095845 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a75dc1b2-e140-4482-b099-09e0bfceff41 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:11.096301 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a75dc1b2-e140-4482-b099-09e0bfceff41 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:11.223053 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a75dc1b2-e140-4482-b099-09e0bfceff41 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:11.230525 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a75dc1b2-e140-4482-b099-09e0bfceff41 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.147068 Aug 17 23:44:11.231094 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 81/157] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:11 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:11.495598 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-35006ba7-6dde-4852-9153-56dcc39df649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:11.496259 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-35006ba7-6dde-4852-9153-56dcc39df649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:11.502155 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-35006ba7-6dde-4852-9153-56dcc39df649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:11.502636 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-35006ba7-6dde-4852-9153-56dcc39df649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:11.503072 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-35006ba7-6dde-4852-9153-56dcc39df649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:11.503755 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-35006ba7-6dde-4852-9153-56dcc39df649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:11.504242 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-35006ba7-6dde-4852-9153-56dcc39df649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:11.504664 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-35006ba7-6dde-4852-9153-56dcc39df649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:11.607947 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-36e95cd4-c6cf-4f26-85cc-0a1a771ec861 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:11.609164 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-36e95cd4-c6cf-4f26-85cc-0a1a771ec861 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:11.615505 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-36e95cd4-c6cf-4f26-85cc-0a1a771ec861 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:11.616670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-36e95cd4-c6cf-4f26-85cc-0a1a771ec861 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:11.617179 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-36e95cd4-c6cf-4f26-85cc-0a1a771ec861 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:11.618449 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-36e95cd4-c6cf-4f26-85cc-0a1a771ec861 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:11.619268 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-36e95cd4-c6cf-4f26-85cc-0a1a771ec861 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:11.620032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-36e95cd4-c6cf-4f26-85cc-0a1a771ec861 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:12.020907 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-35006ba7-6dde-4852-9153-56dcc39df649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:12.029623 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-35006ba7-6dde-4852-9153-56dcc39df649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:12.032041 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-35006ba7-6dde-4852-9153-56dcc39df649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:12.033195 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-35006ba7-6dde-4852-9153-56dcc39df649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.541440 Aug 17 23:44:12.055671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 77/158] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:11 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:12.065753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f2beff88-f209-48b4-8e5f-7200ff2cda38 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:12.066392 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f2beff88-f209-48b4-8e5f-7200ff2cda38 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:12.076169 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=95 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:44:12.078191 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2beff88-f209-48b4-8e5f-7200ff2cda38 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:12.078691 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2beff88-f209-48b4-8e5f-7200ff2cda38 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:12.079132 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2beff88-f209-48b4-8e5f-7200ff2cda38 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:12.079835 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2beff88-f209-48b4-8e5f-7200ff2cda38 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:12.080319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2beff88-f209-48b4-8e5f-7200ff2cda38 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:12.080753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2beff88-f209-48b4-8e5f-7200ff2cda38 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:12.185744 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-36e95cd4-c6cf-4f26-85cc-0a1a771ec861 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:12.195118 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-36e95cd4-c6cf-4f26-85cc-0a1a771ec861 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.601010 Aug 17 23:44:12.209108 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 82/159] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:11 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:12.253821 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-7da4036a-acb3-44df-a856-08607ba46673 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:12.254503 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-7da4036a-acb3-44df-a856-08607ba46673 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:12.260512 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7da4036a-acb3-44df-a856-08607ba46673 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:12.261002 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7da4036a-acb3-44df-a856-08607ba46673 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:12.261439 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7da4036a-acb3-44df-a856-08607ba46673 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:12.262135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7da4036a-acb3-44df-a856-08607ba46673 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:12.262589 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7da4036a-acb3-44df-a856-08607ba46673 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:12.263011 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7da4036a-acb3-44df-a856-08607ba46673 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:12.364877 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f2beff88-f209-48b4-8e5f-7200ff2cda38 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:12.373188 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f2beff88-f209-48b4-8e5f-7200ff2cda38 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.316159 Aug 17 23:44:12.374488 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 78/160] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:12 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:12.528206 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-7da4036a-acb3-44df-a856-08607ba46673 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:12.536603 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-7da4036a-acb3-44df-a856-08607ba46673 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.288200 Aug 17 23:44:12.544143 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 83/161] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:12 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:12.776991 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-062a705d-5c12-46da-bc74-5c9850f4a0a5 req-8af7e346-5907-4319-8b03-6622ea1f0d37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abc34597-7782-4715-86c3-6a940ecde323", "tag": "bce8dab3-ded2-46e7-a72a-7a52eb3c9201"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:44:12.796503 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-062a705d-5c12-46da-bc74-5c9850f4a0a5 req-8af7e346-5907-4319-8b03-6622ea1f0d37 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:12.797065 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-062a705d-5c12-46da-bc74-5c9850f4a0a5 req-8af7e346-5907-4319-8b03-6622ea1f0d37 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:12.797563 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-062a705d-5c12-46da-bc74-5c9850f4a0a5 req-8af7e346-5907-4319-8b03-6622ea1f0d37 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:12.818509 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-062a705d-5c12-46da-bc74-5c9850f4a0a5 req-8af7e346-5907-4319-8b03-6622ea1f0d37 service nova] Creating event network-changed:bce8dab3-ded2-46e7-a72a-7a52eb3c9201 for instance abc34597-7782-4715-86c3-6a940ecde323 on hv-cinder-82002 Aug 17 23:44:12.819037 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-062a705d-5c12-46da-bc74-5c9850f4a0a5 req-8af7e346-5907-4319-8b03-6622ea1f0d37 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=131395) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 17 23:44:12.819515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-062a705d-5c12-46da-bc74-5c9850f4a0a5 req-8af7e346-5907-4319-8b03-6622ea1f0d37 service nova] Acquired lock "compute-rpcapi-router" {{(pid=131395) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 17 23:44:12.820744 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ef489c6c-32be-473e-93b7-19e744c79dfa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:12.821106 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ef489c6c-32be-473e-93b7-19e744c79dfa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:12.821550 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ef489c6c-32be-473e-93b7-19e744c79dfa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:12.823082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ef489c6c-32be-473e-93b7-19e744c79dfa None None] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:12.823589 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ef489c6c-32be-473e-93b7-19e744c79dfa None None] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:12.824199 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ef489c6c-32be-473e-93b7-19e744c79dfa None None] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:12.833664 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.compute.rpcapi [None req-ef489c6c-32be-473e-93b7-19e744c79dfa None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 17 23:44:12.834540 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ef489c6c-32be-473e-93b7-19e744c79dfa None None] Releasing lock "compute-rpcapi-router" {{(pid=131395) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 17 23:44:12.850504 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ef489c6c-32be-473e-93b7-19e744c79dfa None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077295 Aug 17 23:44:12.851303 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 79/162] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:44:13.058667 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e18932c4-d660-4431-88e1-e61c39011e20 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:13.059287 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e18932c4-d660-4431-88e1-e61c39011e20 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:13.065397 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e18932c4-d660-4431-88e1-e61c39011e20 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:13.065888 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e18932c4-d660-4431-88e1-e61c39011e20 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:13.066323 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e18932c4-d660-4431-88e1-e61c39011e20 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:13.067020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e18932c4-d660-4431-88e1-e61c39011e20 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:13.067484 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e18932c4-d660-4431-88e1-e61c39011e20 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:13.067911 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e18932c4-d660-4431-88e1-e61c39011e20 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:13.205186 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e18932c4-d660-4431-88e1-e61c39011e20 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:13.214515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e18932c4-d660-4431-88e1-e61c39011e20 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:13.216638 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e18932c4-d660-4431-88e1-e61c39011e20 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:13.217934 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e18932c4-d660-4431-88e1-e61c39011e20 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.163156 Aug 17 23:44:13.218485 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 84/163] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:13 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:13.227166 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3dc12a8d-0f14-4537-bf30-856affb6181c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:13.228007 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3dc12a8d-0f14-4537-bf30-856affb6181c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:13.236763 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3dc12a8d-0f14-4537-bf30-856affb6181c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:13.237459 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3dc12a8d-0f14-4537-bf30-856affb6181c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:13.238032 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3dc12a8d-0f14-4537-bf30-856affb6181c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:13.238753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3dc12a8d-0f14-4537-bf30-856affb6181c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:13.239222 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3dc12a8d-0f14-4537-bf30-856affb6181c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:13.239793 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3dc12a8d-0f14-4537-bf30-856affb6181c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:13.380057 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3dc12a8d-0f14-4537-bf30-856affb6181c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:13.388145 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3dc12a8d-0f14-4537-bf30-856affb6181c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.166388 Aug 17 23:44:13.388714 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 80/164] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:13 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:13.394706 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-aefacaad-005e-4f0d-aec6-48c17f7c5619 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:13.395314 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-aefacaad-005e-4f0d-aec6-48c17f7c5619 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:13.401245 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aefacaad-005e-4f0d-aec6-48c17f7c5619 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:13.401723 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aefacaad-005e-4f0d-aec6-48c17f7c5619 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:13.402159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aefacaad-005e-4f0d-aec6-48c17f7c5619 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:13.402840 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aefacaad-005e-4f0d-aec6-48c17f7c5619 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:13.403295 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aefacaad-005e-4f0d-aec6-48c17f7c5619 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:13.403717 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aefacaad-005e-4f0d-aec6-48c17f7c5619 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:13.548044 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-aefacaad-005e-4f0d-aec6-48c17f7c5619 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:13.551535 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=100 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:44:13.558359 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-aefacaad-005e-4f0d-aec6-48c17f7c5619 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.167427 Aug 17 23:44:13.559168 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 85/165] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:13 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:13.570345 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1be6d3b0-0d61-434a-a1a6-6ccaac0ca2d6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:13.571025 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-1be6d3b0-0d61-434a-a1a6-6ccaac0ca2d6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:13.577691 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1be6d3b0-0d61-434a-a1a6-6ccaac0ca2d6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:13.578195 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1be6d3b0-0d61-434a-a1a6-6ccaac0ca2d6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:13.578713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1be6d3b0-0d61-434a-a1a6-6ccaac0ca2d6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:13.579316 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1be6d3b0-0d61-434a-a1a6-6ccaac0ca2d6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:13.579983 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1be6d3b0-0d61-434a-a1a6-6ccaac0ca2d6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:13.580837 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1be6d3b0-0d61-434a-a1a6-6ccaac0ca2d6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:13.720792 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1be6d3b0-0d61-434a-a1a6-6ccaac0ca2d6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:13.729554 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-1be6d3b0-0d61-434a-a1a6-6ccaac0ca2d6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.173767 Aug 17 23:44:13.730335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 81/166] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:13 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:14.244856 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d4f8a4d2-4587-4c30-9c64-54fbffb456ba tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:14.246478 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d4f8a4d2-4587-4c30-9c64-54fbffb456ba tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:14.253755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d4f8a4d2-4587-4c30-9c64-54fbffb456ba tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:14.254515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d4f8a4d2-4587-4c30-9c64-54fbffb456ba tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:14.255123 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d4f8a4d2-4587-4c30-9c64-54fbffb456ba tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:14.256412 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d4f8a4d2-4587-4c30-9c64-54fbffb456ba tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:14.257173 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d4f8a4d2-4587-4c30-9c64-54fbffb456ba tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:14.257760 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d4f8a4d2-4587-4c30-9c64-54fbffb456ba tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:14.410423 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ded192fa-0537-4d14-86e4-6134ada90cc6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:14.411144 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ded192fa-0537-4d14-86e4-6134ada90cc6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:14.421146 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ded192fa-0537-4d14-86e4-6134ada90cc6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:14.422816 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ded192fa-0537-4d14-86e4-6134ada90cc6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:14.424519 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ded192fa-0537-4d14-86e4-6134ada90cc6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:14.426392 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ded192fa-0537-4d14-86e4-6134ada90cc6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:14.426870 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ded192fa-0537-4d14-86e4-6134ada90cc6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:14.427301 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ded192fa-0537-4d14-86e4-6134ada90cc6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:14.429720 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d4f8a4d2-4587-4c30-9c64-54fbffb456ba tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:14.438518 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d4f8a4d2-4587-4c30-9c64-54fbffb456ba tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:14.440102 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d4f8a4d2-4587-4c30-9c64-54fbffb456ba tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:14.441224 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d4f8a4d2-4587-4c30-9c64-54fbffb456ba tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.202286 Aug 17 23:44:14.441770 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 86/167] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:14 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:14.581876 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8cdf2f26-84b7-48c2-b094-ebdca5a0d5fa tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:14.582572 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8cdf2f26-84b7-48c2-b094-ebdca5a0d5fa tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:14.603995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8cdf2f26-84b7-48c2-b094-ebdca5a0d5fa tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:14.606900 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8cdf2f26-84b7-48c2-b094-ebdca5a0d5fa tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:14.608075 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8cdf2f26-84b7-48c2-b094-ebdca5a0d5fa tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:14.613363 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8cdf2f26-84b7-48c2-b094-ebdca5a0d5fa tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:14.614071 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8cdf2f26-84b7-48c2-b094-ebdca5a0d5fa tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:14.615738 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8cdf2f26-84b7-48c2-b094-ebdca5a0d5fa tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:14.700726 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ded192fa-0537-4d14-86e4-6134ada90cc6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:14.715542 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ded192fa-0537-4d14-86e4-6134ada90cc6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.310426 Aug 17 23:44:14.729068 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 82/168] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:14 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:14.795854 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-8cdf2f26-84b7-48c2-b094-ebdca5a0d5fa tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:14.796578 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-3d5dac54-d053-4f59-b0b1-c5831ae329b9 req-b82fdee6-f7e6-4f51-97d8-81d10335e2ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d619bf9d-15c1-4cef-bcc3-4a792878bf73", "name": "network-vif-plugged", "status": "completed", "tag": "f60e9126-8ff5-4a1e-bdee-fcf39e05162b"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:44:14.803279 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8cdf2f26-84b7-48c2-b094-ebdca5a0d5fa tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.227627 Aug 17 23:44:14.803923 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 87/169] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:14 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:14.805726 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-3d5dac54-d053-4f59-b0b1-c5831ae329b9 req-b82fdee6-f7e6-4f51-97d8-81d10335e2ae service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:14.806190 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-3d5dac54-d053-4f59-b0b1-c5831ae329b9 req-b82fdee6-f7e6-4f51-97d8-81d10335e2ae service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:14.807156 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-3d5dac54-d053-4f59-b0b1-c5831ae329b9 req-b82fdee6-f7e6-4f51-97d8-81d10335e2ae service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:14.808712 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b8a696aa-04d6-403f-b0a2-6b2d49601961 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:14.809305 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b8a696aa-04d6-403f-b0a2-6b2d49601961 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:14.815088 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8a696aa-04d6-403f-b0a2-6b2d49601961 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:14.815638 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8a696aa-04d6-403f-b0a2-6b2d49601961 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:14.816226 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8a696aa-04d6-403f-b0a2-6b2d49601961 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:14.816913 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8a696aa-04d6-403f-b0a2-6b2d49601961 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:14.817426 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8a696aa-04d6-403f-b0a2-6b2d49601961 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:14.817963 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8a696aa-04d6-403f-b0a2-6b2d49601961 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:14.818344 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-3d5dac54-d053-4f59-b0b1-c5831ae329b9 req-b82fdee6-f7e6-4f51-97d8-81d10335e2ae service nova] Creating event network-vif-plugged:f60e9126-8ff5-4a1e-bdee-fcf39e05162b for instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 on hv-cinder-82002 Aug 17 23:44:14.824128 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-3d5dac54-d053-4f59-b0b1-c5831ae329b9 req-b82fdee6-f7e6-4f51-97d8-81d10335e2ae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093581 Aug 17 23:44:14.824761 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 83/170] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:44:14.944755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b8a696aa-04d6-403f-b0a2-6b2d49601961 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:14.952967 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b8a696aa-04d6-403f-b0a2-6b2d49601961 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.148158 Aug 17 23:44:14.957884 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 88/171] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:14 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:15.468134 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c3ff6bc1-d3d8-46bc-b356-cf9558b1be00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:15.468929 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c3ff6bc1-d3d8-46bc-b356-cf9558b1be00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:15.475716 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c3ff6bc1-d3d8-46bc-b356-cf9558b1be00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:15.476257 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c3ff6bc1-d3d8-46bc-b356-cf9558b1be00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:15.476843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c3ff6bc1-d3d8-46bc-b356-cf9558b1be00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:15.477605 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c3ff6bc1-d3d8-46bc-b356-cf9558b1be00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:15.478111 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c3ff6bc1-d3d8-46bc-b356-cf9558b1be00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:15.478762 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c3ff6bc1-d3d8-46bc-b356-cf9558b1be00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:15.638621 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c3ff6bc1-d3d8-46bc-b356-cf9558b1be00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:15.646727 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c3ff6bc1-d3d8-46bc-b356-cf9558b1be00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:15.649766 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c3ff6bc1-d3d8-46bc-b356-cf9558b1be00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:15.650931 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c3ff6bc1-d3d8-46bc-b356-cf9558b1be00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.187990 Aug 17 23:44:15.651494 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 84/172] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:15 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:15.739669 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-866248f7-1a66-479d-9113-8c29b01cbeb5 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:15.740350 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-866248f7-1a66-479d-9113-8c29b01cbeb5 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:15.747088 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-866248f7-1a66-479d-9113-8c29b01cbeb5 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:15.747579 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-866248f7-1a66-479d-9113-8c29b01cbeb5 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:15.748042 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-866248f7-1a66-479d-9113-8c29b01cbeb5 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:15.748737 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-866248f7-1a66-479d-9113-8c29b01cbeb5 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:15.749195 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-866248f7-1a66-479d-9113-8c29b01cbeb5 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:15.749623 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-866248f7-1a66-479d-9113-8c29b01cbeb5 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:15.825450 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b74eb498-7b13-4497-b90c-13cfa2b72d0a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:15.826057 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b74eb498-7b13-4497-b90c-13cfa2b72d0a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:15.831900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b74eb498-7b13-4497-b90c-13cfa2b72d0a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:15.832412 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b74eb498-7b13-4497-b90c-13cfa2b72d0a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:15.832844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b74eb498-7b13-4497-b90c-13cfa2b72d0a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:15.833522 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b74eb498-7b13-4497-b90c-13cfa2b72d0a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:15.834091 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b74eb498-7b13-4497-b90c-13cfa2b72d0a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:15.834634 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b74eb498-7b13-4497-b90c-13cfa2b72d0a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:15.878903 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-866248f7-1a66-479d-9113-8c29b01cbeb5 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:15.886746 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-866248f7-1a66-479d-9113-8c29b01cbeb5 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.151146 Aug 17 23:44:15.887307 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 89/173] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:15 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:15.962052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b74eb498-7b13-4497-b90c-13cfa2b72d0a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:15.970027 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b74eb498-7b13-4497-b90c-13cfa2b72d0a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.149100 Aug 17 23:44:15.970594 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 85/174] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:15 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:15.973085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-47af22f7-9f13-4dd9-9940-c8d94aa6cdb4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:15.973701 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-47af22f7-9f13-4dd9-9940-c8d94aa6cdb4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:15.979539 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-47af22f7-9f13-4dd9-9940-c8d94aa6cdb4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:15.980047 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-47af22f7-9f13-4dd9-9940-c8d94aa6cdb4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:15.980497 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-47af22f7-9f13-4dd9-9940-c8d94aa6cdb4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:15.981184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-47af22f7-9f13-4dd9-9940-c8d94aa6cdb4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:15.981639 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-47af22f7-9f13-4dd9-9940-c8d94aa6cdb4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:15.982075 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-47af22f7-9f13-4dd9-9940-c8d94aa6cdb4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:16.109879 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-47af22f7-9f13-4dd9-9940-c8d94aa6cdb4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:16.117280 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-47af22f7-9f13-4dd9-9940-c8d94aa6cdb4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.148159 Aug 17 23:44:16.117841 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 90/175] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:15 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:16.673090 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-26fab523-8e34-451d-898a-d18db7737b4d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:16.673697 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-26fab523-8e34-451d-898a-d18db7737b4d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:16.679602 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-26fab523-8e34-451d-898a-d18db7737b4d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:16.680119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-26fab523-8e34-451d-898a-d18db7737b4d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:16.680556 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-26fab523-8e34-451d-898a-d18db7737b4d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:16.681237 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-26fab523-8e34-451d-898a-d18db7737b4d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:16.682292 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-26fab523-8e34-451d-898a-d18db7737b4d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:16.682718 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-26fab523-8e34-451d-898a-d18db7737b4d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:16.825570 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-26fab523-8e34-451d-898a-d18db7737b4d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:16.833465 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-26fab523-8e34-451d-898a-d18db7737b4d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:16.834951 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-26fab523-8e34-451d-898a-d18db7737b4d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:16.836181 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-26fab523-8e34-451d-898a-d18db7737b4d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.166772 Aug 17 23:44:16.836746 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 86/176] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:16 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:16.907427 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-29949393-6e81-4d69-8b65-aef5f05c698d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:16.907991 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-29949393-6e81-4d69-8b65-aef5f05c698d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:16.914206 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-29949393-6e81-4d69-8b65-aef5f05c698d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:16.914686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-29949393-6e81-4d69-8b65-aef5f05c698d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:16.915122 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-29949393-6e81-4d69-8b65-aef5f05c698d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:16.915798 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-29949393-6e81-4d69-8b65-aef5f05c698d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:16.916288 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-29949393-6e81-4d69-8b65-aef5f05c698d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:16.916713 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-29949393-6e81-4d69-8b65-aef5f05c698d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:16.990944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-799df652-2c87-42b1-827d-41d4def3a731 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:16.991264 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-799df652-2c87-42b1-827d-41d4def3a731 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:16.997764 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-799df652-2c87-42b1-827d-41d4def3a731 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:16.998245 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-799df652-2c87-42b1-827d-41d4def3a731 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:16.998706 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-799df652-2c87-42b1-827d-41d4def3a731 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:16.999393 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-799df652-2c87-42b1-827d-41d4def3a731 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:16.999846 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-799df652-2c87-42b1-827d-41d4def3a731 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:17.000302 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-799df652-2c87-42b1-827d-41d4def3a731 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:17.042475 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-29949393-6e81-4d69-8b65-aef5f05c698d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:17.049959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-29949393-6e81-4d69-8b65-aef5f05c698d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.146380 Aug 17 23:44:17.050530 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 91/177] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:16 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:17.126657 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-799df652-2c87-42b1-827d-41d4def3a731 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:17.133929 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-799df652-2c87-42b1-827d-41d4def3a731 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.147207 Aug 17 23:44:17.134488 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 87/178] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:16 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:17.138226 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-3dcf1a17-960a-4329-b24f-41f9b7517ef8 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:17.138837 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-3dcf1a17-960a-4329-b24f-41f9b7517ef8 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:17.144624 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3dcf1a17-960a-4329-b24f-41f9b7517ef8 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:17.145106 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3dcf1a17-960a-4329-b24f-41f9b7517ef8 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:17.145538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3dcf1a17-960a-4329-b24f-41f9b7517ef8 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:17.146216 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3dcf1a17-960a-4329-b24f-41f9b7517ef8 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:17.146666 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3dcf1a17-960a-4329-b24f-41f9b7517ef8 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:17.147087 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3dcf1a17-960a-4329-b24f-41f9b7517ef8 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:17.273189 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-3dcf1a17-960a-4329-b24f-41f9b7517ef8 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:17.280912 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-3dcf1a17-960a-4329-b24f-41f9b7517ef8 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.147156 Aug 17 23:44:17.281477 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 92/179] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:17 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:17.857906 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-20f96f0f-5f0b-48d5-9635-31d77bf5783f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:17.858504 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-20f96f0f-5f0b-48d5-9635-31d77bf5783f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:17.864296 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-20f96f0f-5f0b-48d5-9635-31d77bf5783f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:17.864771 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-20f96f0f-5f0b-48d5-9635-31d77bf5783f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:17.865235 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-20f96f0f-5f0b-48d5-9635-31d77bf5783f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:17.865910 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-20f96f0f-5f0b-48d5-9635-31d77bf5783f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:17.866361 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-20f96f0f-5f0b-48d5-9635-31d77bf5783f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:17.866785 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-20f96f0f-5f0b-48d5-9635-31d77bf5783f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:17.994607 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-20f96f0f-5f0b-48d5-9635-31d77bf5783f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:18.002462 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-20f96f0f-5f0b-48d5-9635-31d77bf5783f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:18.003990 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-20f96f0f-5f0b-48d5-9635-31d77bf5783f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:18.005094 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-20f96f0f-5f0b-48d5-9635-31d77bf5783f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.150966 Aug 17 23:44:18.005652 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 88/180] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:17 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:18.070681 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-bb87d27c-25b5-40b5-8e42-8c2e6656e3be tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:18.071324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-bb87d27c-25b5-40b5-8e42-8c2e6656e3be tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:18.077931 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb87d27c-25b5-40b5-8e42-8c2e6656e3be tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:18.078419 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb87d27c-25b5-40b5-8e42-8c2e6656e3be tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:18.078857 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb87d27c-25b5-40b5-8e42-8c2e6656e3be tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:18.079547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb87d27c-25b5-40b5-8e42-8c2e6656e3be tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:18.080025 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb87d27c-25b5-40b5-8e42-8c2e6656e3be tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:18.080459 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb87d27c-25b5-40b5-8e42-8c2e6656e3be tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:18.154669 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9cdc2072-13d3-4e5a-9c45-525ca9b757c7 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:18.155334 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9cdc2072-13d3-4e5a-9c45-525ca9b757c7 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:18.161393 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9cdc2072-13d3-4e5a-9c45-525ca9b757c7 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:18.161882 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9cdc2072-13d3-4e5a-9c45-525ca9b757c7 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:18.162321 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9cdc2072-13d3-4e5a-9c45-525ca9b757c7 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:18.163012 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9cdc2072-13d3-4e5a-9c45-525ca9b757c7 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:18.163466 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9cdc2072-13d3-4e5a-9c45-525ca9b757c7 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:18.163889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9cdc2072-13d3-4e5a-9c45-525ca9b757c7 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:18.205701 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-bb87d27c-25b5-40b5-8e42-8c2e6656e3be tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:18.213135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-bb87d27c-25b5-40b5-8e42-8c2e6656e3be tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.146275 Aug 17 23:44:18.213708 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 93/181] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:18 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:18.295809 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9cdc2072-13d3-4e5a-9c45-525ca9b757c7 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:18.302866 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b2b7ff09-8aa3-40f4-899e-7f034a6286a1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:18.303486 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b2b7ff09-8aa3-40f4-899e-7f034a6286a1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:18.304359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9cdc2072-13d3-4e5a-9c45-525ca9b757c7 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.153528 Aug 17 23:44:18.305177 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 89/182] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:18 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:18.309913 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b2b7ff09-8aa3-40f4-899e-7f034a6286a1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:18.310395 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b2b7ff09-8aa3-40f4-899e-7f034a6286a1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:18.310834 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b2b7ff09-8aa3-40f4-899e-7f034a6286a1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:18.311525 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b2b7ff09-8aa3-40f4-899e-7f034a6286a1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:18.312001 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b2b7ff09-8aa3-40f4-899e-7f034a6286a1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:18.312451 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b2b7ff09-8aa3-40f4-899e-7f034a6286a1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:18.437571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b2b7ff09-8aa3-40f4-899e-7f034a6286a1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:18.445003 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b2b7ff09-8aa3-40f4-899e-7f034a6286a1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.146131 Aug 17 23:44:18.445578 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 94/183] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:18 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:19.027527 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-763b4f77-14af-403b-8723-db4a949f6263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:19.028084 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-763b4f77-14af-403b-8723-db4a949f6263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:19.033925 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-763b4f77-14af-403b-8723-db4a949f6263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:19.034399 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-763b4f77-14af-403b-8723-db4a949f6263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:19.034828 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-763b4f77-14af-403b-8723-db4a949f6263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:19.035753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-763b4f77-14af-403b-8723-db4a949f6263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:19.036228 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-763b4f77-14af-403b-8723-db4a949f6263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:19.036648 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-763b4f77-14af-403b-8723-db4a949f6263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:19.161855 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-763b4f77-14af-403b-8723-db4a949f6263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:19.169650 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-763b4f77-14af-403b-8723-db4a949f6263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:19.171184 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-763b4f77-14af-403b-8723-db4a949f6263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:19.172299 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-763b4f77-14af-403b-8723-db4a949f6263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.149334 Aug 17 23:44:19.172854 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 90/184] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:19 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:19.233794 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-35b60c98-3830-468e-b8c4-7dbb85c235e8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:19.234398 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-35b60c98-3830-468e-b8c4-7dbb85c235e8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:19.240214 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-35b60c98-3830-468e-b8c4-7dbb85c235e8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:19.240693 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-35b60c98-3830-468e-b8c4-7dbb85c235e8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:19.241124 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-35b60c98-3830-468e-b8c4-7dbb85c235e8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:19.241796 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-35b60c98-3830-468e-b8c4-7dbb85c235e8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:19.242245 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-35b60c98-3830-468e-b8c4-7dbb85c235e8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:19.242663 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-35b60c98-3830-468e-b8c4-7dbb85c235e8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:19.326293 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-bcf44774-d5ee-4b72-8bf2-3987c7571616 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:19.327069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-bcf44774-d5ee-4b72-8bf2-3987c7571616 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:19.332824 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bcf44774-d5ee-4b72-8bf2-3987c7571616 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:19.333300 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bcf44774-d5ee-4b72-8bf2-3987c7571616 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:19.333736 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bcf44774-d5ee-4b72-8bf2-3987c7571616 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:19.334423 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bcf44774-d5ee-4b72-8bf2-3987c7571616 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:19.334874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bcf44774-d5ee-4b72-8bf2-3987c7571616 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:19.335293 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bcf44774-d5ee-4b72-8bf2-3987c7571616 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:19.339323 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=100 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:44:19.373901 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-35b60c98-3830-468e-b8c4-7dbb85c235e8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:19.381298 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-35b60c98-3830-468e-b8c4-7dbb85c235e8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.151265 Aug 17 23:44:19.381988 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 95/185] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:19 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:19.466165 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-6b47fb83-f0e3-43d3-9d99-3a031fc36861 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:19.466773 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-6b47fb83-f0e3-43d3-9d99-3a031fc36861 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:19.467560 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-bcf44774-d5ee-4b72-8bf2-3987c7571616 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:19.468628 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=100 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:44:19.473680 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6b47fb83-f0e3-43d3-9d99-3a031fc36861 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:19.474160 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6b47fb83-f0e3-43d3-9d99-3a031fc36861 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:19.474592 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6b47fb83-f0e3-43d3-9d99-3a031fc36861 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:19.475246 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-bcf44774-d5ee-4b72-8bf2-3987c7571616 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.153330 Aug 17 23:44:19.475362 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6b47fb83-f0e3-43d3-9d99-3a031fc36861 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:19.475710 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6b47fb83-f0e3-43d3-9d99-3a031fc36861 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:19.475800 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 91/186] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:19 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:19.480021 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6b47fb83-f0e3-43d3-9d99-3a031fc36861 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:19.600268 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-6b47fb83-f0e3-43d3-9d99-3a031fc36861 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:19.608097 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-6b47fb83-f0e3-43d3-9d99-3a031fc36861 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.146323 Aug 17 23:44:19.608654 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 96/187] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:19 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:20.194230 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f91c6c9e-19b2-4b45-bbdc-f157ce0b7837 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:20.194770 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f91c6c9e-19b2-4b45-bbdc-f157ce0b7837 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:20.201351 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f91c6c9e-19b2-4b45-bbdc-f157ce0b7837 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:20.201836 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f91c6c9e-19b2-4b45-bbdc-f157ce0b7837 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:20.202278 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f91c6c9e-19b2-4b45-bbdc-f157ce0b7837 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:20.202965 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f91c6c9e-19b2-4b45-bbdc-f157ce0b7837 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:20.203424 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f91c6c9e-19b2-4b45-bbdc-f157ce0b7837 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:20.203866 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f91c6c9e-19b2-4b45-bbdc-f157ce0b7837 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:20.336536 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f91c6c9e-19b2-4b45-bbdc-f157ce0b7837 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:20.344917 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f91c6c9e-19b2-4b45-bbdc-f157ce0b7837 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:20.346418 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f91c6c9e-19b2-4b45-bbdc-f157ce0b7837 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:20.347532 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f91c6c9e-19b2-4b45-bbdc-f157ce0b7837 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.157266 Aug 17 23:44:20.348117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 92/188] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:20 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:20.404609 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ede3f8cb-bca2-4e37-9fb6-faabd29b3a3f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:20.405222 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ede3f8cb-bca2-4e37-9fb6-faabd29b3a3f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:20.411510 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ede3f8cb-bca2-4e37-9fb6-faabd29b3a3f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:20.412027 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ede3f8cb-bca2-4e37-9fb6-faabd29b3a3f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:20.412493 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ede3f8cb-bca2-4e37-9fb6-faabd29b3a3f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:20.413181 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ede3f8cb-bca2-4e37-9fb6-faabd29b3a3f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:20.413631 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ede3f8cb-bca2-4e37-9fb6-faabd29b3a3f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:20.414054 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ede3f8cb-bca2-4e37-9fb6-faabd29b3a3f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:20.497195 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-cde76749-7dfb-4ef1-ba11-b24ebb3f8083 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:20.498012 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-cde76749-7dfb-4ef1-ba11-b24ebb3f8083 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:20.504321 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cde76749-7dfb-4ef1-ba11-b24ebb3f8083 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:20.504811 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cde76749-7dfb-4ef1-ba11-b24ebb3f8083 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:20.505249 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cde76749-7dfb-4ef1-ba11-b24ebb3f8083 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:20.505941 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cde76749-7dfb-4ef1-ba11-b24ebb3f8083 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:20.506556 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cde76749-7dfb-4ef1-ba11-b24ebb3f8083 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:20.507301 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cde76749-7dfb-4ef1-ba11-b24ebb3f8083 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:20.564805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ede3f8cb-bca2-4e37-9fb6-faabd29b3a3f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:20.573130 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ede3f8cb-bca2-4e37-9fb6-faabd29b3a3f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.174081 Aug 17 23:44:20.574072 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 97/189] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:20 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:20.628329 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-cbf5f825-68d7-41b6-9bbf-4e4288e46735 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:20.628945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-cbf5f825-68d7-41b6-9bbf-4e4288e46735 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:20.636017 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cbf5f825-68d7-41b6-9bbf-4e4288e46735 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:20.636485 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cbf5f825-68d7-41b6-9bbf-4e4288e46735 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:20.636922 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cbf5f825-68d7-41b6-9bbf-4e4288e46735 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:20.637615 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cbf5f825-68d7-41b6-9bbf-4e4288e46735 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:20.638074 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cbf5f825-68d7-41b6-9bbf-4e4288e46735 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:20.638502 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cbf5f825-68d7-41b6-9bbf-4e4288e46735 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:20.646065 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-cde76749-7dfb-4ef1-ba11-b24ebb3f8083 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:20.654203 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-cde76749-7dfb-4ef1-ba11-b24ebb3f8083 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.161446 Aug 17 23:44:20.654774 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 93/190] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:20 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:20.767712 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-cbf5f825-68d7-41b6-9bbf-4e4288e46735 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:20.775103 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-cbf5f825-68d7-41b6-9bbf-4e4288e46735 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.150765 Aug 17 23:44:20.775670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 98/191] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:20 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:21.371434 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b304efdc-91ae-4f75-b5c9-39f408b1ad28 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:21.371936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b304efdc-91ae-4f75-b5c9-39f408b1ad28 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:21.377785 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b304efdc-91ae-4f75-b5c9-39f408b1ad28 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:21.378263 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b304efdc-91ae-4f75-b5c9-39f408b1ad28 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:21.378697 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b304efdc-91ae-4f75-b5c9-39f408b1ad28 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:21.379366 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b304efdc-91ae-4f75-b5c9-39f408b1ad28 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:21.379830 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b304efdc-91ae-4f75-b5c9-39f408b1ad28 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:21.380259 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b304efdc-91ae-4f75-b5c9-39f408b1ad28 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:21.510194 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b304efdc-91ae-4f75-b5c9-39f408b1ad28 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:21.518102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b304efdc-91ae-4f75-b5c9-39f408b1ad28 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:21.519612 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b304efdc-91ae-4f75-b5c9-39f408b1ad28 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:21.520753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b304efdc-91ae-4f75-b5c9-39f408b1ad28 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.153900 Aug 17 23:44:21.521302 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 94/192] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:21 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:21.594237 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a3fb61e0-5db1-4d29-bd1c-7ce86f99bb0e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:21.594884 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a3fb61e0-5db1-4d29-bd1c-7ce86f99bb0e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:21.600793 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3fb61e0-5db1-4d29-bd1c-7ce86f99bb0e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:21.601275 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3fb61e0-5db1-4d29-bd1c-7ce86f99bb0e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:21.601717 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3fb61e0-5db1-4d29-bd1c-7ce86f99bb0e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:21.602406 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3fb61e0-5db1-4d29-bd1c-7ce86f99bb0e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:21.602862 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3fb61e0-5db1-4d29-bd1c-7ce86f99bb0e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:21.603293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3fb61e0-5db1-4d29-bd1c-7ce86f99bb0e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:21.674580 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-72efc5bc-1275-486b-9631-a377ec2d9a5b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:21.675207 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-72efc5bc-1275-486b-9631-a377ec2d9a5b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:21.681213 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-72efc5bc-1275-486b-9631-a377ec2d9a5b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:21.682368 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-72efc5bc-1275-486b-9631-a377ec2d9a5b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:21.683262 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-72efc5bc-1275-486b-9631-a377ec2d9a5b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:21.683627 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-72efc5bc-1275-486b-9631-a377ec2d9a5b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:21.684225 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-72efc5bc-1275-486b-9631-a377ec2d9a5b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:21.684662 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-72efc5bc-1275-486b-9631-a377ec2d9a5b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:21.747548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a3fb61e0-5db1-4d29-bd1c-7ce86f99bb0e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:21.761344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a3fb61e0-5db1-4d29-bd1c-7ce86f99bb0e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.170928 Aug 17 23:44:21.761947 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 99/193] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:21 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:21.797032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-0ad92306-49a6-4c38-b4fb-9c5e7dfa06af tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:21.797767 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-0ad92306-49a6-4c38-b4fb-9c5e7dfa06af tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:21.803772 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0ad92306-49a6-4c38-b4fb-9c5e7dfa06af tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:21.804289 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0ad92306-49a6-4c38-b4fb-9c5e7dfa06af tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:21.804725 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0ad92306-49a6-4c38-b4fb-9c5e7dfa06af tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:21.805409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0ad92306-49a6-4c38-b4fb-9c5e7dfa06af tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:21.805858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0ad92306-49a6-4c38-b4fb-9c5e7dfa06af tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:21.806275 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0ad92306-49a6-4c38-b4fb-9c5e7dfa06af tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:21.824039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-72efc5bc-1275-486b-9631-a377ec2d9a5b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:21.831589 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-72efc5bc-1275-486b-9631-a377ec2d9a5b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.160835 Aug 17 23:44:21.832241 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 95/194] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:21 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:21.936814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0ad92306-49a6-4c38-b4fb-9c5e7dfa06af tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:21.944769 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-0ad92306-49a6-4c38-b4fb-9c5e7dfa06af tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.151712 Aug 17 23:44:21.945416 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 100/195] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:21 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:22.543425 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-fcac4ee5-1b6e-42fd-b55c-d84786301993 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:22.544721 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-fcac4ee5-1b6e-42fd-b55c-d84786301993 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:22.551040 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fcac4ee5-1b6e-42fd-b55c-d84786301993 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:22.551725 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fcac4ee5-1b6e-42fd-b55c-d84786301993 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:22.552360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fcac4ee5-1b6e-42fd-b55c-d84786301993 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:22.553071 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fcac4ee5-1b6e-42fd-b55c-d84786301993 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:22.554880 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fcac4ee5-1b6e-42fd-b55c-d84786301993 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:22.555320 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fcac4ee5-1b6e-42fd-b55c-d84786301993 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:22.631935 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-b7a591d3-476c-4426-842f-19123f8eeecd req-e195dea0-c786-47dc-97b1-ddbaf66e910a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c46dee0-bdd3-468a-ad6d-52a9f50e8210", "name": "network-vif-plugged", "status": "completed", "tag": "021b5852-09eb-4120-9100-b585b3d1065b"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:44:22.651197 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-b7a591d3-476c-4426-842f-19123f8eeecd req-e195dea0-c786-47dc-97b1-ddbaf66e910a service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:22.651771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-b7a591d3-476c-4426-842f-19123f8eeecd req-e195dea0-c786-47dc-97b1-ddbaf66e910a service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:22.652240 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-b7a591d3-476c-4426-842f-19123f8eeecd req-e195dea0-c786-47dc-97b1-ddbaf66e910a service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:22.664313 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-b7a591d3-476c-4426-842f-19123f8eeecd req-e195dea0-c786-47dc-97b1-ddbaf66e910a service nova] Creating event network-vif-plugged:021b5852-09eb-4120-9100-b585b3d1065b for instance 8c46dee0-bdd3-468a-ad6d-52a9f50e8210 on hv-cinder-82002 Aug 17 23:44:22.669945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-b7a591d3-476c-4426-842f-19123f8eeecd req-e195dea0-c786-47dc-97b1-ddbaf66e910a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041950 Aug 17 23:44:22.670890 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 101/196] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:44:22.698040 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-fcac4ee5-1b6e-42fd-b55c-d84786301993 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:22.706023 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-fcac4ee5-1b6e-42fd-b55c-d84786301993 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:22.707467 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-fcac4ee5-1b6e-42fd-b55c-d84786301993 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:22.708584 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-fcac4ee5-1b6e-42fd-b55c-d84786301993 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.169622 Aug 17 23:44:22.709146 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 96/197] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:22 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:22.786328 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b8267fcd-3062-4573-919c-46d4d11abe35 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:22.787024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b8267fcd-3062-4573-919c-46d4d11abe35 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:22.793860 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8267fcd-3062-4573-919c-46d4d11abe35 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:22.794367 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8267fcd-3062-4573-919c-46d4d11abe35 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:22.794817 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8267fcd-3062-4573-919c-46d4d11abe35 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:22.795516 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8267fcd-3062-4573-919c-46d4d11abe35 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:22.795984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8267fcd-3062-4573-919c-46d4d11abe35 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:22.796405 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8267fcd-3062-4573-919c-46d4d11abe35 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:22.852453 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-4887c081-d6e0-4a1a-9330-3db0d0b0757f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:22.853073 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-4887c081-d6e0-4a1a-9330-3db0d0b0757f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:22.855445 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:44:22.861342 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4887c081-d6e0-4a1a-9330-3db0d0b0757f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:22.861842 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4887c081-d6e0-4a1a-9330-3db0d0b0757f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:22.862285 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4887c081-d6e0-4a1a-9330-3db0d0b0757f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:22.862989 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4887c081-d6e0-4a1a-9330-3db0d0b0757f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:22.863451 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4887c081-d6e0-4a1a-9330-3db0d0b0757f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:22.863880 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4887c081-d6e0-4a1a-9330-3db0d0b0757f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:22.940763 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b8267fcd-3062-4573-919c-46d4d11abe35 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:22.949374 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b8267fcd-3062-4573-919c-46d4d11abe35 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.168337 Aug 17 23:44:22.950123 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 102/198] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:22 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:22.969839 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-90cfa7db-5201-4fa0-b8d6-eb0a977990c8 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:22.970568 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-90cfa7db-5201-4fa0-b8d6-eb0a977990c8 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:22.977026 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-90cfa7db-5201-4fa0-b8d6-eb0a977990c8 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:22.977519 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-90cfa7db-5201-4fa0-b8d6-eb0a977990c8 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:22.977962 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-90cfa7db-5201-4fa0-b8d6-eb0a977990c8 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:22.978693 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-90cfa7db-5201-4fa0-b8d6-eb0a977990c8 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:22.979150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-90cfa7db-5201-4fa0-b8d6-eb0a977990c8 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:22.979577 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-90cfa7db-5201-4fa0-b8d6-eb0a977990c8 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:22.983842 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=100 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:44:22.998709 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-4887c081-d6e0-4a1a-9330-3db0d0b0757f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:23.014188 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-4887c081-d6e0-4a1a-9330-3db0d0b0757f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.165567 Aug 17 23:44:23.017160 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 97/199] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:22 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:23.148714 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-90cfa7db-5201-4fa0-b8d6-eb0a977990c8 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:23.162420 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-90cfa7db-5201-4fa0-b8d6-eb0a977990c8 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.196588 Aug 17 23:44:23.172353 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 103/200] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:22 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:23.731189 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0436c457-651c-4e71-ab2d-98823db519d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:23.731804 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0436c457-651c-4e71-ab2d-98823db519d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:23.737737 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0436c457-651c-4e71-ab2d-98823db519d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:23.738161 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0436c457-651c-4e71-ab2d-98823db519d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:23.738595 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0436c457-651c-4e71-ab2d-98823db519d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:23.739272 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0436c457-651c-4e71-ab2d-98823db519d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:23.739729 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0436c457-651c-4e71-ab2d-98823db519d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:23.740182 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0436c457-651c-4e71-ab2d-98823db519d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:23.866555 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0436c457-651c-4e71-ab2d-98823db519d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:23.874371 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0436c457-651c-4e71-ab2d-98823db519d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:23.875868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0436c457-651c-4e71-ab2d-98823db519d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:23.877000 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0436c457-651c-4e71-ab2d-98823db519d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.150361 Aug 17 23:44:23.877575 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 98/201] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:23 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:23.970501 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d5098700-8cfd-45ef-9a91-20c1826628f7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:23.971123 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d5098700-8cfd-45ef-9a91-20c1826628f7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:23.976985 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5098700-8cfd-45ef-9a91-20c1826628f7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:23.977459 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5098700-8cfd-45ef-9a91-20c1826628f7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:23.977893 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5098700-8cfd-45ef-9a91-20c1826628f7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:23.979221 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5098700-8cfd-45ef-9a91-20c1826628f7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:23.979667 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5098700-8cfd-45ef-9a91-20c1826628f7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:23.980129 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5098700-8cfd-45ef-9a91-20c1826628f7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:24.037471 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f4f41f36-f7ca-49ea-898d-29487dd96d2a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:24.037998 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f4f41f36-f7ca-49ea-898d-29487dd96d2a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:24.044491 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f4f41f36-f7ca-49ea-898d-29487dd96d2a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:24.044974 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f4f41f36-f7ca-49ea-898d-29487dd96d2a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:24.045407 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f4f41f36-f7ca-49ea-898d-29487dd96d2a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:24.046092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f4f41f36-f7ca-49ea-898d-29487dd96d2a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:24.046540 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f4f41f36-f7ca-49ea-898d-29487dd96d2a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:24.046957 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f4f41f36-f7ca-49ea-898d-29487dd96d2a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:24.111906 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d5098700-8cfd-45ef-9a91-20c1826628f7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:24.119567 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d5098700-8cfd-45ef-9a91-20c1826628f7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.152885 Aug 17 23:44:24.120257 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 104/202] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:23 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:24.173929 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f4f41f36-f7ca-49ea-898d-29487dd96d2a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:24.181449 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f4f41f36-f7ca-49ea-898d-29487dd96d2a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.148144 Aug 17 23:44:24.182009 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 99/203] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:24 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:24.188708 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-036d4072-ad2e-421d-b741-ed62dcbc1498 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:24.189350 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-036d4072-ad2e-421d-b741-ed62dcbc1498 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:24.195696 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-036d4072-ad2e-421d-b741-ed62dcbc1498 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:24.196212 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-036d4072-ad2e-421d-b741-ed62dcbc1498 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:24.196644 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-036d4072-ad2e-421d-b741-ed62dcbc1498 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:24.197866 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-036d4072-ad2e-421d-b741-ed62dcbc1498 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:24.198315 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-036d4072-ad2e-421d-b741-ed62dcbc1498 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:24.198790 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-036d4072-ad2e-421d-b741-ed62dcbc1498 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:24.334698 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-036d4072-ad2e-421d-b741-ed62dcbc1498 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:24.342800 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-036d4072-ad2e-421d-b741-ed62dcbc1498 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.163265 Aug 17 23:44:24.343373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 105/204] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:24 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:24.901341 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-07e2999c-a6f3-4fd9-8983-804ebe18a7ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:24.901920 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-07e2999c-a6f3-4fd9-8983-804ebe18a7ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:24.907807 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-07e2999c-a6f3-4fd9-8983-804ebe18a7ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:24.908310 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-07e2999c-a6f3-4fd9-8983-804ebe18a7ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:24.908742 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-07e2999c-a6f3-4fd9-8983-804ebe18a7ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:24.909415 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-07e2999c-a6f3-4fd9-8983-804ebe18a7ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:24.909865 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-07e2999c-a6f3-4fd9-8983-804ebe18a7ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:24.910530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-07e2999c-a6f3-4fd9-8983-804ebe18a7ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:25.034529 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-07e2999c-a6f3-4fd9-8983-804ebe18a7ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:25.043105 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-07e2999c-a6f3-4fd9-8983-804ebe18a7ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:25.044642 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-07e2999c-a6f3-4fd9-8983-804ebe18a7ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:25.045732 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-07e2999c-a6f3-4fd9-8983-804ebe18a7ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.148925 Aug 17 23:44:25.046287 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 100/205] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:24 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:25.140812 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-7a51eb75-d555-4d80-b06d-daeb345d2351 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:25.141422 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-7a51eb75-d555-4d80-b06d-daeb345d2351 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:25.147298 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7a51eb75-d555-4d80-b06d-daeb345d2351 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:25.147759 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7a51eb75-d555-4d80-b06d-daeb345d2351 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:25.148222 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7a51eb75-d555-4d80-b06d-daeb345d2351 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:25.148901 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7a51eb75-d555-4d80-b06d-daeb345d2351 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:25.149356 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7a51eb75-d555-4d80-b06d-daeb345d2351 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:25.149773 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7a51eb75-d555-4d80-b06d-daeb345d2351 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:25.201399 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-975021a8-89e5-47a9-9830-adf07ad98ff1 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:25.201919 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-975021a8-89e5-47a9-9830-adf07ad98ff1 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:25.207750 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-975021a8-89e5-47a9-9830-adf07ad98ff1 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:25.208268 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-975021a8-89e5-47a9-9830-adf07ad98ff1 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:25.208704 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-975021a8-89e5-47a9-9830-adf07ad98ff1 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:25.209382 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-975021a8-89e5-47a9-9830-adf07ad98ff1 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:25.209838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-975021a8-89e5-47a9-9830-adf07ad98ff1 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:25.210258 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-975021a8-89e5-47a9-9830-adf07ad98ff1 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:25.280102 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-7a51eb75-d555-4d80-b06d-daeb345d2351 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:25.287783 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-7a51eb75-d555-4d80-b06d-daeb345d2351 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.150819 Aug 17 23:44:25.288548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 106/206] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:25 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:25.342254 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-975021a8-89e5-47a9-9830-adf07ad98ff1 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:25.349556 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-975021a8-89e5-47a9-9830-adf07ad98ff1 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.152043 Aug 17 23:44:25.350131 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 101/207] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:25 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:25.363250 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-443a33bc-1614-4d65-8bda-10980aa68bad tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:25.363852 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-443a33bc-1614-4d65-8bda-10980aa68bad tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:25.370238 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-443a33bc-1614-4d65-8bda-10980aa68bad tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:25.370710 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-443a33bc-1614-4d65-8bda-10980aa68bad tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:25.371137 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-443a33bc-1614-4d65-8bda-10980aa68bad tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:25.371814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-443a33bc-1614-4d65-8bda-10980aa68bad tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:25.372295 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-443a33bc-1614-4d65-8bda-10980aa68bad tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:25.372715 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-443a33bc-1614-4d65-8bda-10980aa68bad tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:25.507456 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-443a33bc-1614-4d65-8bda-10980aa68bad tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:25.515488 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-443a33bc-1614-4d65-8bda-10980aa68bad tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.156016 Aug 17 23:44:25.516064 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 107/208] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:25 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:26.068388 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1af57ce1-ce96-4fb2-a70f-23d81a30975a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:26.068939 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-1af57ce1-ce96-4fb2-a70f-23d81a30975a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:26.075310 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1af57ce1-ce96-4fb2-a70f-23d81a30975a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:26.075798 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1af57ce1-ce96-4fb2-a70f-23d81a30975a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:26.076263 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1af57ce1-ce96-4fb2-a70f-23d81a30975a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:26.076965 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1af57ce1-ce96-4fb2-a70f-23d81a30975a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:26.077401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1af57ce1-ce96-4fb2-a70f-23d81a30975a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:26.077818 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1af57ce1-ce96-4fb2-a70f-23d81a30975a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:26.202537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1af57ce1-ce96-4fb2-a70f-23d81a30975a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:26.210301 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1af57ce1-ce96-4fb2-a70f-23d81a30975a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:26.211842 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1af57ce1-ce96-4fb2-a70f-23d81a30975a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:26.212964 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-1af57ce1-ce96-4fb2-a70f-23d81a30975a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.148608 Aug 17 23:44:26.213513 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 102/209] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:26 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:26.309666 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1f7e7579-0c79-4108-b70a-fe613d74aebf tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:26.310279 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1f7e7579-0c79-4108-b70a-fe613d74aebf tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:26.316240 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1f7e7579-0c79-4108-b70a-fe613d74aebf tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:26.316726 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1f7e7579-0c79-4108-b70a-fe613d74aebf tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:26.317174 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1f7e7579-0c79-4108-b70a-fe613d74aebf tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:26.317860 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1f7e7579-0c79-4108-b70a-fe613d74aebf tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:26.318318 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1f7e7579-0c79-4108-b70a-fe613d74aebf tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:26.318797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1f7e7579-0c79-4108-b70a-fe613d74aebf tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:26.370859 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ed0f427e-e0ac-432b-8485-17f3e9fb3bca tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:26.371468 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ed0f427e-e0ac-432b-8485-17f3e9fb3bca tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:26.380432 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ed0f427e-e0ac-432b-8485-17f3e9fb3bca tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:26.380432 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ed0f427e-e0ac-432b-8485-17f3e9fb3bca tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:26.380432 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ed0f427e-e0ac-432b-8485-17f3e9fb3bca tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:26.380432 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ed0f427e-e0ac-432b-8485-17f3e9fb3bca tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:26.380818 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ed0f427e-e0ac-432b-8485-17f3e9fb3bca tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:26.380818 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ed0f427e-e0ac-432b-8485-17f3e9fb3bca tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:26.446096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1f7e7579-0c79-4108-b70a-fe613d74aebf tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:26.454119 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1f7e7579-0c79-4108-b70a-fe613d74aebf tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.148743 Aug 17 23:44:26.454975 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 108/210] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:26 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:26.523132 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ed0f427e-e0ac-432b-8485-17f3e9fb3bca tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:26.531392 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ed0f427e-e0ac-432b-8485-17f3e9fb3bca tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.164938 Aug 17 23:44:26.531947 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 103/211] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:26 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:26.536405 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9c64612c-6499-4203-a1f4-1a8ae741144f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:26.537006 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9c64612c-6499-4203-a1f4-1a8ae741144f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:26.546666 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9c64612c-6499-4203-a1f4-1a8ae741144f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:26.547153 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9c64612c-6499-4203-a1f4-1a8ae741144f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:26.547583 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9c64612c-6499-4203-a1f4-1a8ae741144f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:26.548379 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9c64612c-6499-4203-a1f4-1a8ae741144f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:26.548838 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9c64612c-6499-4203-a1f4-1a8ae741144f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:26.549253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9c64612c-6499-4203-a1f4-1a8ae741144f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:26.677843 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9c64612c-6499-4203-a1f4-1a8ae741144f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:26.685177 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9c64612c-6499-4203-a1f4-1a8ae741144f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.152863 Aug 17 23:44:26.685741 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 109/212] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:26 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:27.235186 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-85012a2f-fd76-4827-9b55-42a975324d65 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:27.235826 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-85012a2f-fd76-4827-9b55-42a975324d65 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:27.241787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-85012a2f-fd76-4827-9b55-42a975324d65 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:27.242273 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-85012a2f-fd76-4827-9b55-42a975324d65 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:27.242708 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-85012a2f-fd76-4827-9b55-42a975324d65 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:27.243395 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-85012a2f-fd76-4827-9b55-42a975324d65 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:27.244492 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-85012a2f-fd76-4827-9b55-42a975324d65 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:27.244930 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-85012a2f-fd76-4827-9b55-42a975324d65 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:27.369930 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-85012a2f-fd76-4827-9b55-42a975324d65 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:27.377857 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-85012a2f-fd76-4827-9b55-42a975324d65 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:27.379403 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-85012a2f-fd76-4827-9b55-42a975324d65 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:27.380559 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-85012a2f-fd76-4827-9b55-42a975324d65 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.149253 Aug 17 23:44:27.381121 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 104/213] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:27 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:27.475084 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8caf94a5-0db7-4170-9859-9a7331b8fa1d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:27.475692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8caf94a5-0db7-4170-9859-9a7331b8fa1d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:27.481856 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8caf94a5-0db7-4170-9859-9a7331b8fa1d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:27.482344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8caf94a5-0db7-4170-9859-9a7331b8fa1d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:27.482781 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8caf94a5-0db7-4170-9859-9a7331b8fa1d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:27.483466 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8caf94a5-0db7-4170-9859-9a7331b8fa1d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:27.484082 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8caf94a5-0db7-4170-9859-9a7331b8fa1d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:27.484513 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8caf94a5-0db7-4170-9859-9a7331b8fa1d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:27.552375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-794319ec-a13c-42bc-8029-089074f1432b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:27.552993 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-794319ec-a13c-42bc-8029-089074f1432b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:27.560736 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-794319ec-a13c-42bc-8029-089074f1432b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:27.561226 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-794319ec-a13c-42bc-8029-089074f1432b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:27.561674 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-794319ec-a13c-42bc-8029-089074f1432b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:27.562378 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-794319ec-a13c-42bc-8029-089074f1432b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:27.562835 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-794319ec-a13c-42bc-8029-089074f1432b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:27.568708 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-794319ec-a13c-42bc-8029-089074f1432b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:27.613535 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-8caf94a5-0db7-4170-9859-9a7331b8fa1d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:27.621582 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8caf94a5-0db7-4170-9859-9a7331b8fa1d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.150430 Aug 17 23:44:27.622152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 110/214] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:27 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:27.698304 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-794319ec-a13c-42bc-8029-089074f1432b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:27.705787 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ae510426-9ff1-4d2d-ba2a-0e1efe301df3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:27.706364 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-794319ec-a13c-42bc-8029-089074f1432b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.157743 Aug 17 23:44:27.706472 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ae510426-9ff1-4d2d-ba2a-0e1efe301df3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:27.706938 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 105/215] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:27 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:27.712198 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ae510426-9ff1-4d2d-ba2a-0e1efe301df3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:27.712712 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ae510426-9ff1-4d2d-ba2a-0e1efe301df3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:27.713150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ae510426-9ff1-4d2d-ba2a-0e1efe301df3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:27.713833 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ae510426-9ff1-4d2d-ba2a-0e1efe301df3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:27.714290 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ae510426-9ff1-4d2d-ba2a-0e1efe301df3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:27.714710 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ae510426-9ff1-4d2d-ba2a-0e1efe301df3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:27.843312 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ae510426-9ff1-4d2d-ba2a-0e1efe301df3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:27.850655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ae510426-9ff1-4d2d-ba2a-0e1efe301df3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.148629 Aug 17 23:44:27.851217 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 111/216] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:27 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:28.403290 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-cf70ecaa-8b32-478f-95c2-616a1c60aec7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:28.403892 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-cf70ecaa-8b32-478f-95c2-616a1c60aec7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:28.409832 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cf70ecaa-8b32-478f-95c2-616a1c60aec7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:28.410609 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cf70ecaa-8b32-478f-95c2-616a1c60aec7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:28.411042 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cf70ecaa-8b32-478f-95c2-616a1c60aec7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:28.411720 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cf70ecaa-8b32-478f-95c2-616a1c60aec7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:28.412197 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cf70ecaa-8b32-478f-95c2-616a1c60aec7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:28.412623 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cf70ecaa-8b32-478f-95c2-616a1c60aec7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:28.545032 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-cf70ecaa-8b32-478f-95c2-616a1c60aec7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:28.561317 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-cf70ecaa-8b32-478f-95c2-616a1c60aec7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:28.562895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-cf70ecaa-8b32-478f-95c2-616a1c60aec7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:28.564145 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-cf70ecaa-8b32-478f-95c2-616a1c60aec7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.164752 Aug 17 23:44:28.564792 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 106/217] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:28 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:28.642883 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-91d1ef35-40d6-4f41-9a6e-7ec403fc229b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:28.643432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-91d1ef35-40d6-4f41-9a6e-7ec403fc229b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:28.649327 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-91d1ef35-40d6-4f41-9a6e-7ec403fc229b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:28.649806 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-91d1ef35-40d6-4f41-9a6e-7ec403fc229b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:28.650317 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-91d1ef35-40d6-4f41-9a6e-7ec403fc229b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:28.651003 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-91d1ef35-40d6-4f41-9a6e-7ec403fc229b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:28.651445 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-91d1ef35-40d6-4f41-9a6e-7ec403fc229b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:28.651868 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-91d1ef35-40d6-4f41-9a6e-7ec403fc229b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:28.713583 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-806e68e3-7a7c-4ada-8d49-0cda40fa6e45 req-2eb56263-80cc-47df-9807-60523b500596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "259ce9fa-eddc-4fe4-8789-9a13bff9ca86", "name": "network-vif-plugged", "status": "completed", "tag": "80b1223e-6f35-4bf9-b8d0-8d3eb6f8eccc"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:44:28.726929 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-806e68e3-7a7c-4ada-8d49-0cda40fa6e45 req-2eb56263-80cc-47df-9807-60523b500596 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:28.727407 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-806e68e3-7a7c-4ada-8d49-0cda40fa6e45 req-2eb56263-80cc-47df-9807-60523b500596 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:28.727835 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-806e68e3-7a7c-4ada-8d49-0cda40fa6e45 req-2eb56263-80cc-47df-9807-60523b500596 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:28.746416 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-806e68e3-7a7c-4ada-8d49-0cda40fa6e45 req-2eb56263-80cc-47df-9807-60523b500596 service nova] Creating event network-vif-plugged:80b1223e-6f35-4bf9-b8d0-8d3eb6f8eccc for instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 on hv-cinder-82002 Aug 17 23:44:28.752060 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-806e68e3-7a7c-4ada-8d49-0cda40fa6e45 req-2eb56263-80cc-47df-9807-60523b500596 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043285 Aug 17 23:44:28.752665 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 107/218] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:44:28.757637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-398658fe-0709-4ca2-9acb-5f01bad28558 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:28.758323 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-398658fe-0709-4ca2-9acb-5f01bad28558 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:28.764567 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-398658fe-0709-4ca2-9acb-5f01bad28558 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:28.765049 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-398658fe-0709-4ca2-9acb-5f01bad28558 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:28.765480 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-398658fe-0709-4ca2-9acb-5f01bad28558 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:28.766164 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-398658fe-0709-4ca2-9acb-5f01bad28558 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:28.766613 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-398658fe-0709-4ca2-9acb-5f01bad28558 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:28.767039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-398658fe-0709-4ca2-9acb-5f01bad28558 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:28.786775 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-91d1ef35-40d6-4f41-9a6e-7ec403fc229b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:28.787616 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=100 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:44:28.794944 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-91d1ef35-40d6-4f41-9a6e-7ec403fc229b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.156176 Aug 17 23:44:28.795509 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 112/219] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:28 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:28.871161 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-922f69ae-be78-4352-a157-01c40150366a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:28.871903 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-922f69ae-be78-4352-a157-01c40150366a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:28.877963 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-922f69ae-be78-4352-a157-01c40150366a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:28.878561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-922f69ae-be78-4352-a157-01c40150366a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:28.879093 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-922f69ae-be78-4352-a157-01c40150366a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:28.879895 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-922f69ae-be78-4352-a157-01c40150366a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:28.880474 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-922f69ae-be78-4352-a157-01c40150366a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:28.881121 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-922f69ae-be78-4352-a157-01c40150366a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:28.902389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-398658fe-0709-4ca2-9acb-5f01bad28558 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:28.910747 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-398658fe-0709-4ca2-9acb-5f01bad28558 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.156979 Aug 17 23:44:28.911507 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 108/220] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:28 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:29.019166 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-922f69ae-be78-4352-a157-01c40150366a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:29.026537 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-922f69ae-be78-4352-a157-01c40150366a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.159367 Aug 17 23:44:29.027102 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 113/221] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:28 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:29.588184 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5d466507-07fb-4e25-96d8-3cffd7dd541c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:29.588903 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5d466507-07fb-4e25-96d8-3cffd7dd541c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:29.595611 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d466507-07fb-4e25-96d8-3cffd7dd541c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:29.596132 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d466507-07fb-4e25-96d8-3cffd7dd541c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:29.596572 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d466507-07fb-4e25-96d8-3cffd7dd541c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:29.597265 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d466507-07fb-4e25-96d8-3cffd7dd541c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:29.597717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d466507-07fb-4e25-96d8-3cffd7dd541c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:29.598136 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d466507-07fb-4e25-96d8-3cffd7dd541c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:29.817607 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-608b77df-53d0-489a-9276-dada616fc059 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:29.818254 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-608b77df-53d0-489a-9276-dada616fc059 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:29.830349 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-608b77df-53d0-489a-9276-dada616fc059 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:29.831000 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-608b77df-53d0-489a-9276-dada616fc059 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:29.832995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-608b77df-53d0-489a-9276-dada616fc059 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:29.833918 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-608b77df-53d0-489a-9276-dada616fc059 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:29.834407 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-608b77df-53d0-489a-9276-dada616fc059 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:29.836867 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-608b77df-53d0-489a-9276-dada616fc059 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:29.917780 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5d466507-07fb-4e25-96d8-3cffd7dd541c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:29.939438 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5d466507-07fb-4e25-96d8-3cffd7dd541c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:29.943553 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5d466507-07fb-4e25-96d8-3cffd7dd541c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:29.947493 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5d466507-07fb-4e25-96d8-3cffd7dd541c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.362449 Aug 17 23:44:29.950186 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 109/222] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:29 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:29.960302 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2415674f-bf95-4c87-9a36-2b2771bcd3b8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:29.962973 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2415674f-bf95-4c87-9a36-2b2771bcd3b8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:29.978497 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2415674f-bf95-4c87-9a36-2b2771bcd3b8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:29.979376 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2415674f-bf95-4c87-9a36-2b2771bcd3b8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:29.981669 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2415674f-bf95-4c87-9a36-2b2771bcd3b8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:29.984322 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2415674f-bf95-4c87-9a36-2b2771bcd3b8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:29.984928 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2415674f-bf95-4c87-9a36-2b2771bcd3b8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:29.987913 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2415674f-bf95-4c87-9a36-2b2771bcd3b8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:30.268482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-608b77df-53d0-489a-9276-dada616fc059 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:30.276028 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-608b77df-53d0-489a-9276-dada616fc059 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.463467 Aug 17 23:44:30.276594 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 114/223] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:29 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:30.281074 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-2c8ce8cc-68b6-48f5-befb-8d728432b299 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:30.281961 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-2c8ce8cc-68b6-48f5-befb-8d728432b299 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:30.288387 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2c8ce8cc-68b6-48f5-befb-8d728432b299 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:30.288878 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2c8ce8cc-68b6-48f5-befb-8d728432b299 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:30.289328 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2c8ce8cc-68b6-48f5-befb-8d728432b299 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:30.290006 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2c8ce8cc-68b6-48f5-befb-8d728432b299 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:30.290464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2c8ce8cc-68b6-48f5-befb-8d728432b299 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:30.291422 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2c8ce8cc-68b6-48f5-befb-8d728432b299 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:30.465420 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2415674f-bf95-4c87-9a36-2b2771bcd3b8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:30.474777 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2415674f-bf95-4c87-9a36-2b2771bcd3b8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.521820 Aug 17 23:44:30.475367 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 110/224] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:29 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:30.968097 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-2c8ce8cc-68b6-48f5-befb-8d728432b299 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:30.971040 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a502757d-6797-4a60-b0de-090d7c46ef35 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:30.971645 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a502757d-6797-4a60-b0de-090d7c46ef35 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:30.984848 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-2c8ce8cc-68b6-48f5-befb-8d728432b299 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.702432 Aug 17 23:44:30.984979 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a502757d-6797-4a60-b0de-090d7c46ef35 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:30.985410 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a502757d-6797-4a60-b0de-090d7c46ef35 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:30.985845 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a502757d-6797-4a60-b0de-090d7c46ef35 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:30.986597 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 115/225] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:30 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:31.004411 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a502757d-6797-4a60-b0de-090d7c46ef35 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:31.007366 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a502757d-6797-4a60-b0de-090d7c46ef35 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:31.007833 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a502757d-6797-4a60-b0de-090d7c46ef35 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:31.298630 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ce19ceec-cbfd-4113-b7f6-ff1108c12479 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:31.299330 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ce19ceec-cbfd-4113-b7f6-ff1108c12479 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:31.304538 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a502757d-6797-4a60-b0de-090d7c46ef35 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:31.307291 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce19ceec-cbfd-4113-b7f6-ff1108c12479 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:31.307913 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce19ceec-cbfd-4113-b7f6-ff1108c12479 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:31.308626 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce19ceec-cbfd-4113-b7f6-ff1108c12479 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:31.309404 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce19ceec-cbfd-4113-b7f6-ff1108c12479 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:31.309972 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce19ceec-cbfd-4113-b7f6-ff1108c12479 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:31.310507 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce19ceec-cbfd-4113-b7f6-ff1108c12479 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:31.316454 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a502757d-6797-4a60-b0de-090d7c46ef35 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:31.318291 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a502757d-6797-4a60-b0de-090d7c46ef35 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:31.323716 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a502757d-6797-4a60-b0de-090d7c46ef35 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.353044 Aug 17 23:44:31.325609 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 111/226] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:30 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:44:31.497308 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c644b471-c0c0-406d-9d10-05c8f29948d6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:31.497940 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c644b471-c0c0-406d-9d10-05c8f29948d6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:31.500784 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ce19ceec-cbfd-4113-b7f6-ff1108c12479 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:31.507359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c644b471-c0c0-406d-9d10-05c8f29948d6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:31.508660 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c644b471-c0c0-406d-9d10-05c8f29948d6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:31.510094 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c644b471-c0c0-406d-9d10-05c8f29948d6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:31.511312 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c644b471-c0c0-406d-9d10-05c8f29948d6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:31.512247 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c644b471-c0c0-406d-9d10-05c8f29948d6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:31.514151 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ce19ceec-cbfd-4113-b7f6-ff1108c12479 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.219757 Aug 17 23:44:31.515402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 116/227] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:31 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:31.516665 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c644b471-c0c0-406d-9d10-05c8f29948d6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:31.787295 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c644b471-c0c0-406d-9d10-05c8f29948d6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:31.796250 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c644b471-c0c0-406d-9d10-05c8f29948d6 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.303500 Aug 17 23:44:31.796849 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 112/228] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:31 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:32.006658 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1b2900ec-16bf-4176-a80b-2ef3bcab49eb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:32.007253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1b2900ec-16bf-4176-a80b-2ef3bcab49eb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:32.013084 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1b2900ec-16bf-4176-a80b-2ef3bcab49eb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:32.013562 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1b2900ec-16bf-4176-a80b-2ef3bcab49eb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:32.013995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1b2900ec-16bf-4176-a80b-2ef3bcab49eb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:32.014669 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1b2900ec-16bf-4176-a80b-2ef3bcab49eb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:32.015119 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1b2900ec-16bf-4176-a80b-2ef3bcab49eb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:32.015538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1b2900ec-16bf-4176-a80b-2ef3bcab49eb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:32.146246 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1b2900ec-16bf-4176-a80b-2ef3bcab49eb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:32.154144 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1b2900ec-16bf-4176-a80b-2ef3bcab49eb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.151431 Aug 17 23:44:32.154803 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 117/229] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:32 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:32.350753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-fd624f2c-f2fd-4d82-9ad7-0eb91f74fc7e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:32.351439 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-fd624f2c-f2fd-4d82-9ad7-0eb91f74fc7e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:32.358457 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fd624f2c-f2fd-4d82-9ad7-0eb91f74fc7e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:32.359017 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fd624f2c-f2fd-4d82-9ad7-0eb91f74fc7e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:32.359513 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fd624f2c-f2fd-4d82-9ad7-0eb91f74fc7e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:32.360410 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fd624f2c-f2fd-4d82-9ad7-0eb91f74fc7e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:32.361014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fd624f2c-f2fd-4d82-9ad7-0eb91f74fc7e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:32.361643 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fd624f2c-f2fd-4d82-9ad7-0eb91f74fc7e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:32.499377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-fd624f2c-f2fd-4d82-9ad7-0eb91f74fc7e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:32.507299 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-fd624f2c-f2fd-4d82-9ad7-0eb91f74fc7e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:32.508832 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-fd624f2c-f2fd-4d82-9ad7-0eb91f74fc7e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:32.510415 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-fd624f2c-f2fd-4d82-9ad7-0eb91f74fc7e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.166473 Aug 17 23:44:32.510956 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 113/230] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:32 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:32.536645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-423b11b6-a6ca-477c-8fe0-5d880ac9eb85 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:32.537193 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-423b11b6-a6ca-477c-8fe0-5d880ac9eb85 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:32.542985 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-423b11b6-a6ca-477c-8fe0-5d880ac9eb85 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:32.543466 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-423b11b6-a6ca-477c-8fe0-5d880ac9eb85 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:32.543901 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-423b11b6-a6ca-477c-8fe0-5d880ac9eb85 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:32.544617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-423b11b6-a6ca-477c-8fe0-5d880ac9eb85 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:32.545064 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-423b11b6-a6ca-477c-8fe0-5d880ac9eb85 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:32.545530 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-423b11b6-a6ca-477c-8fe0-5d880ac9eb85 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:32.673206 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-423b11b6-a6ca-477c-8fe0-5d880ac9eb85 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:32.680706 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-423b11b6-a6ca-477c-8fe0-5d880ac9eb85 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.148389 Aug 17 23:44:32.681264 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 118/231] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:32 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:32.817554 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-cfd300f5-e6ad-46c4-9132-c0fce37b2788 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:32.818204 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-cfd300f5-e6ad-46c4-9132-c0fce37b2788 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:32.824751 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cfd300f5-e6ad-46c4-9132-c0fce37b2788 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:32.825228 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cfd300f5-e6ad-46c4-9132-c0fce37b2788 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:32.825691 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cfd300f5-e6ad-46c4-9132-c0fce37b2788 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:32.826367 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cfd300f5-e6ad-46c4-9132-c0fce37b2788 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:32.826821 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cfd300f5-e6ad-46c4-9132-c0fce37b2788 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:32.827243 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cfd300f5-e6ad-46c4-9132-c0fce37b2788 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:32.953448 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-cfd300f5-e6ad-46c4-9132-c0fce37b2788 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:32.960850 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-cfd300f5-e6ad-46c4-9132-c0fce37b2788 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.147110 Aug 17 23:44:32.961406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 114/232] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:32 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:33.174753 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b70ad2b0-4062-41b7-970a-73abf10b1c5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:33.175317 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b70ad2b0-4062-41b7-970a-73abf10b1c5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:33.181237 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b70ad2b0-4062-41b7-970a-73abf10b1c5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:33.181718 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b70ad2b0-4062-41b7-970a-73abf10b1c5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:33.182157 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b70ad2b0-4062-41b7-970a-73abf10b1c5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:33.182834 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b70ad2b0-4062-41b7-970a-73abf10b1c5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:33.183286 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b70ad2b0-4062-41b7-970a-73abf10b1c5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:33.183711 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b70ad2b0-4062-41b7-970a-73abf10b1c5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:33.307990 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b70ad2b0-4062-41b7-970a-73abf10b1c5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:33.311351 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=100 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:44:33.316736 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b70ad2b0-4062-41b7-970a-73abf10b1c5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.145969 Aug 17 23:44:33.317303 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 119/233] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:33 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:33.532411 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b226d536-3e56-491d-88ec-d6697d244cd9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:33.533023 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b226d536-3e56-491d-88ec-d6697d244cd9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:33.539369 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b226d536-3e56-491d-88ec-d6697d244cd9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:33.539868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b226d536-3e56-491d-88ec-d6697d244cd9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:33.540377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b226d536-3e56-491d-88ec-d6697d244cd9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:33.541077 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b226d536-3e56-491d-88ec-d6697d244cd9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:33.541536 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b226d536-3e56-491d-88ec-d6697d244cd9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:33.541991 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b226d536-3e56-491d-88ec-d6697d244cd9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:33.668536 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b226d536-3e56-491d-88ec-d6697d244cd9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:33.676539 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b226d536-3e56-491d-88ec-d6697d244cd9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:33.678030 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b226d536-3e56-491d-88ec-d6697d244cd9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:33.679132 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b226d536-3e56-491d-88ec-d6697d244cd9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.150708 Aug 17 23:44:33.679682 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 115/234] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:33 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:33.701728 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-774eaabe-306f-40ee-8412-ad9a082540e0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:33.702346 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-774eaabe-306f-40ee-8412-ad9a082540e0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:33.708347 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-774eaabe-306f-40ee-8412-ad9a082540e0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:33.708836 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-774eaabe-306f-40ee-8412-ad9a082540e0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:33.709277 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-774eaabe-306f-40ee-8412-ad9a082540e0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:33.709967 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-774eaabe-306f-40ee-8412-ad9a082540e0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:33.710425 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-774eaabe-306f-40ee-8412-ad9a082540e0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:33.710851 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-774eaabe-306f-40ee-8412-ad9a082540e0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:33.841096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-774eaabe-306f-40ee-8412-ad9a082540e0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:33.848643 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-774eaabe-306f-40ee-8412-ad9a082540e0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.150709 Aug 17 23:44:33.849194 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 120/235] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:33 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:33.981037 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-909344db-538f-4e98-afbf-5c983bbfee7c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:33.981653 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-909344db-538f-4e98-afbf-5c983bbfee7c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:33.987534 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-909344db-538f-4e98-afbf-5c983bbfee7c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:33.988037 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-909344db-538f-4e98-afbf-5c983bbfee7c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:33.988481 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-909344db-538f-4e98-afbf-5c983bbfee7c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:33.989166 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-909344db-538f-4e98-afbf-5c983bbfee7c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:33.989627 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-909344db-538f-4e98-afbf-5c983bbfee7c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:33.990054 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-909344db-538f-4e98-afbf-5c983bbfee7c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:34.113349 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-909344db-538f-4e98-afbf-5c983bbfee7c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:34.120710 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-909344db-538f-4e98-afbf-5c983bbfee7c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.143446 Aug 17 23:44:34.121272 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 116/236] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:33 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:34.337742 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-de924ca5-d3e4-41fe-bc7e-f2b1cedbd733 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:34.338263 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-de924ca5-d3e4-41fe-bc7e-f2b1cedbd733 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:34.344163 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de924ca5-d3e4-41fe-bc7e-f2b1cedbd733 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:34.344647 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de924ca5-d3e4-41fe-bc7e-f2b1cedbd733 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:34.345097 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de924ca5-d3e4-41fe-bc7e-f2b1cedbd733 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:34.345868 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de924ca5-d3e4-41fe-bc7e-f2b1cedbd733 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:34.346323 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de924ca5-d3e4-41fe-bc7e-f2b1cedbd733 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:34.346750 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de924ca5-d3e4-41fe-bc7e-f2b1cedbd733 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:34.477890 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-de924ca5-d3e4-41fe-bc7e-f2b1cedbd733 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:34.485451 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-de924ca5-d3e4-41fe-bc7e-f2b1cedbd733 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.151614 Aug 17 23:44:34.486200 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 121/237] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:34 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:34.701493 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ca390006-4e16-49b0-bf13-ddc03fc1ec67 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:34.702122 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ca390006-4e16-49b0-bf13-ddc03fc1ec67 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:34.708022 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ca390006-4e16-49b0-bf13-ddc03fc1ec67 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:34.708510 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ca390006-4e16-49b0-bf13-ddc03fc1ec67 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:34.708951 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ca390006-4e16-49b0-bf13-ddc03fc1ec67 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:34.709642 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ca390006-4e16-49b0-bf13-ddc03fc1ec67 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:34.710114 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ca390006-4e16-49b0-bf13-ddc03fc1ec67 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:34.710527 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ca390006-4e16-49b0-bf13-ddc03fc1ec67 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:34.843678 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ca390006-4e16-49b0-bf13-ddc03fc1ec67 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:34.852153 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ca390006-4e16-49b0-bf13-ddc03fc1ec67 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:34.854151 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ca390006-4e16-49b0-bf13-ddc03fc1ec67 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:34.855244 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ca390006-4e16-49b0-bf13-ddc03fc1ec67 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.157658 Aug 17 23:44:34.855802 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 117/238] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:34 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:34.876726 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-0da7135c-9d05-4a2a-bfaf-613a57dfd3fb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:34.877313 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-0da7135c-9d05-4a2a-bfaf-613a57dfd3fb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:34.883171 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0da7135c-9d05-4a2a-bfaf-613a57dfd3fb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:34.883651 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0da7135c-9d05-4a2a-bfaf-613a57dfd3fb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:34.884119 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0da7135c-9d05-4a2a-bfaf-613a57dfd3fb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:34.885336 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0da7135c-9d05-4a2a-bfaf-613a57dfd3fb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:34.886089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0da7135c-9d05-4a2a-bfaf-613a57dfd3fb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:34.886520 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0da7135c-9d05-4a2a-bfaf-613a57dfd3fb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:35.023987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0da7135c-9d05-4a2a-bfaf-613a57dfd3fb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:35.031592 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-0da7135c-9d05-4a2a-bfaf-613a57dfd3fb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.158741 Aug 17 23:44:35.032192 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 122/239] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:34 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:35.141389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9870b522-2051-4354-8522-24736d5759e9 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:35.141921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9870b522-2051-4354-8522-24736d5759e9 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:35.147811 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9870b522-2051-4354-8522-24736d5759e9 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:35.148326 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9870b522-2051-4354-8522-24736d5759e9 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:35.148762 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9870b522-2051-4354-8522-24736d5759e9 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:35.149445 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9870b522-2051-4354-8522-24736d5759e9 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:35.149898 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9870b522-2051-4354-8522-24736d5759e9 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:35.150314 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9870b522-2051-4354-8522-24736d5759e9 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:35.277477 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9870b522-2051-4354-8522-24736d5759e9 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:35.284904 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9870b522-2051-4354-8522-24736d5759e9 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.147377 Aug 17 23:44:35.285720 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 118/240] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:35 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:35.505906 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e079b574-e88d-47e9-9cd0-86fc2a3dd7ce tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:35.506511 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e079b574-e88d-47e9-9cd0-86fc2a3dd7ce tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:35.513060 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e079b574-e88d-47e9-9cd0-86fc2a3dd7ce tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:35.513537 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e079b574-e88d-47e9-9cd0-86fc2a3dd7ce tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:35.513965 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e079b574-e88d-47e9-9cd0-86fc2a3dd7ce tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:35.514670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e079b574-e88d-47e9-9cd0-86fc2a3dd7ce tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:35.515117 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e079b574-e88d-47e9-9cd0-86fc2a3dd7ce tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:35.515534 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e079b574-e88d-47e9-9cd0-86fc2a3dd7ce tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:35.641553 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e079b574-e88d-47e9-9cd0-86fc2a3dd7ce tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:35.648938 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e079b574-e88d-47e9-9cd0-86fc2a3dd7ce tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.146877 Aug 17 23:44:35.649512 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 123/241] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:35 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:35.878577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-d0070f6f-a511-4934-9377-122cb3729dc2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:35.879170 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-d0070f6f-a511-4934-9377-122cb3729dc2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:35.885996 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d0070f6f-a511-4934-9377-122cb3729dc2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:35.886481 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d0070f6f-a511-4934-9377-122cb3729dc2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:35.886919 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d0070f6f-a511-4934-9377-122cb3729dc2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:35.887676 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d0070f6f-a511-4934-9377-122cb3729dc2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:35.888162 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d0070f6f-a511-4934-9377-122cb3729dc2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:35.888589 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d0070f6f-a511-4934-9377-122cb3729dc2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:36.014192 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d0070f6f-a511-4934-9377-122cb3729dc2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:36.022061 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d0070f6f-a511-4934-9377-122cb3729dc2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:36.023567 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d0070f6f-a511-4934-9377-122cb3729dc2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:36.024721 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-d0070f6f-a511-4934-9377-122cb3729dc2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.150121 Aug 17 23:44:36.025273 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 119/242] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:35 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:36.053029 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9fb2a5e0-234c-4c29-b307-c00536d959e9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:36.053567 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9fb2a5e0-234c-4c29-b307-c00536d959e9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:36.059805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9fb2a5e0-234c-4c29-b307-c00536d959e9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:36.060394 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9fb2a5e0-234c-4c29-b307-c00536d959e9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:36.060821 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9fb2a5e0-234c-4c29-b307-c00536d959e9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:36.061502 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9fb2a5e0-234c-4c29-b307-c00536d959e9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:36.061948 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9fb2a5e0-234c-4c29-b307-c00536d959e9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:36.062364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9fb2a5e0-234c-4c29-b307-c00536d959e9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:36.188579 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9fb2a5e0-234c-4c29-b307-c00536d959e9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:36.195947 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9fb2a5e0-234c-4c29-b307-c00536d959e9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.146848 Aug 17 23:44:36.196526 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 124/243] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:36 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:36.305722 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-56ef5939-ee46-431a-a050-4bf5e653889a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:36.306936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-56ef5939-ee46-431a-a050-4bf5e653889a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:36.312832 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-56ef5939-ee46-431a-a050-4bf5e653889a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:36.313315 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-56ef5939-ee46-431a-a050-4bf5e653889a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:36.313750 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-56ef5939-ee46-431a-a050-4bf5e653889a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:36.314432 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-56ef5939-ee46-431a-a050-4bf5e653889a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:36.314885 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-56ef5939-ee46-431a-a050-4bf5e653889a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:36.315308 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-56ef5939-ee46-431a-a050-4bf5e653889a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:36.442809 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-56ef5939-ee46-431a-a050-4bf5e653889a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:36.450681 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-56ef5939-ee46-431a-a050-4bf5e653889a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.148840 Aug 17 23:44:36.451246 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 120/244] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:36 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:36.670175 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-22c8897d-650e-47d9-b8c5-337ad484612b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:36.670836 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-22c8897d-650e-47d9-b8c5-337ad484612b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:36.676714 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-22c8897d-650e-47d9-b8c5-337ad484612b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:36.677191 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-22c8897d-650e-47d9-b8c5-337ad484612b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:36.677626 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-22c8897d-650e-47d9-b8c5-337ad484612b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:36.678297 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-22c8897d-650e-47d9-b8c5-337ad484612b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:36.678745 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-22c8897d-650e-47d9-b8c5-337ad484612b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:36.679166 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-22c8897d-650e-47d9-b8c5-337ad484612b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:36.806562 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-22c8897d-650e-47d9-b8c5-337ad484612b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:36.814342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-22c8897d-650e-47d9-b8c5-337ad484612b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.148022 Aug 17 23:44:36.814902 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 125/245] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:36 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:37.047352 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-584c8bc5-86b7-4b23-ab2f-23ae79690de5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:37.047986 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-584c8bc5-86b7-4b23-ab2f-23ae79690de5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:37.054071 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-584c8bc5-86b7-4b23-ab2f-23ae79690de5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:37.054558 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-584c8bc5-86b7-4b23-ab2f-23ae79690de5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:37.054990 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-584c8bc5-86b7-4b23-ab2f-23ae79690de5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:37.055708 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-584c8bc5-86b7-4b23-ab2f-23ae79690de5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:37.056190 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-584c8bc5-86b7-4b23-ab2f-23ae79690de5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:37.056609 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-584c8bc5-86b7-4b23-ab2f-23ae79690de5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:37.182724 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-584c8bc5-86b7-4b23-ab2f-23ae79690de5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:37.190563 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-584c8bc5-86b7-4b23-ab2f-23ae79690de5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:37.192081 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-584c8bc5-86b7-4b23-ab2f-23ae79690de5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:37.193179 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-584c8bc5-86b7-4b23-ab2f-23ae79690de5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.149815 Aug 17 23:44:37.193906 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 121/246] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:37 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:37.217137 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c3208ed8-5b11-4f02-8ad3-9e71832e9fe7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:37.217755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c3208ed8-5b11-4f02-8ad3-9e71832e9fe7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:37.223832 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c3208ed8-5b11-4f02-8ad3-9e71832e9fe7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:37.224445 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c3208ed8-5b11-4f02-8ad3-9e71832e9fe7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:37.224888 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c3208ed8-5b11-4f02-8ad3-9e71832e9fe7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:37.225584 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c3208ed8-5b11-4f02-8ad3-9e71832e9fe7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:37.226042 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c3208ed8-5b11-4f02-8ad3-9e71832e9fe7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:37.226466 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c3208ed8-5b11-4f02-8ad3-9e71832e9fe7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:37.238571 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-ebf57a27-3a7a-4c33-84ed-5eb2098c956a req-5e47a61d-99bd-4204-a776-a0c8b7b671be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad01f85b-96a2-474a-85f3-7f7c1fd43db7", "name": "network-vif-plugged", "status": "completed", "tag": "8941515b-b419-450f-837f-9dd12af4a0c2"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:44:37.249261 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-ebf57a27-3a7a-4c33-84ed-5eb2098c956a req-5e47a61d-99bd-4204-a776-a0c8b7b671be service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:37.249872 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-ebf57a27-3a7a-4c33-84ed-5eb2098c956a req-5e47a61d-99bd-4204-a776-a0c8b7b671be service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:37.250242 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-ebf57a27-3a7a-4c33-84ed-5eb2098c956a req-5e47a61d-99bd-4204-a776-a0c8b7b671be service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:37.262959 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-ebf57a27-3a7a-4c33-84ed-5eb2098c956a req-5e47a61d-99bd-4204-a776-a0c8b7b671be service nova] Creating event network-vif-plugged:8941515b-b419-450f-837f-9dd12af4a0c2 for instance ad01f85b-96a2-474a-85f3-7f7c1fd43db7 on hv-cinder-82002 Aug 17 23:44:37.268018 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-ebf57a27-3a7a-4c33-84ed-5eb2098c956a req-5e47a61d-99bd-4204-a776-a0c8b7b671be service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033087 Aug 17 23:44:37.268801 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 122/247] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:44:37.358228 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c3208ed8-5b11-4f02-8ad3-9e71832e9fe7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:37.365700 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c3208ed8-5b11-4f02-8ad3-9e71832e9fe7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.152431 Aug 17 23:44:37.366269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 126/248] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:37 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:37.472709 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-aa63c372-9c76-4809-abfa-11b5e23204e7 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:37.473406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-aa63c372-9c76-4809-abfa-11b5e23204e7 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:37.479723 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-aa63c372-9c76-4809-abfa-11b5e23204e7 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:37.480247 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-aa63c372-9c76-4809-abfa-11b5e23204e7 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:37.480681 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-aa63c372-9c76-4809-abfa-11b5e23204e7 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:37.481448 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-aa63c372-9c76-4809-abfa-11b5e23204e7 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:37.481907 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-aa63c372-9c76-4809-abfa-11b5e23204e7 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:37.482357 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-aa63c372-9c76-4809-abfa-11b5e23204e7 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:37.607239 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-aa63c372-9c76-4809-abfa-11b5e23204e7 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:37.614876 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-aa63c372-9c76-4809-abfa-11b5e23204e7 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.146517 Aug 17 23:44:37.615431 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 123/249] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:37 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:37.835639 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-87cd1d6c-b499-434a-9572-61bd4c41b018 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:37.836277 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-87cd1d6c-b499-434a-9572-61bd4c41b018 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:37.842130 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87cd1d6c-b499-434a-9572-61bd4c41b018 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:37.842609 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87cd1d6c-b499-434a-9572-61bd4c41b018 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:37.843043 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87cd1d6c-b499-434a-9572-61bd4c41b018 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:37.843725 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87cd1d6c-b499-434a-9572-61bd4c41b018 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:37.844206 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87cd1d6c-b499-434a-9572-61bd4c41b018 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:37.844631 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87cd1d6c-b499-434a-9572-61bd4c41b018 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:37.973556 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-87cd1d6c-b499-434a-9572-61bd4c41b018 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:37.981535 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-87cd1d6c-b499-434a-9572-61bd4c41b018 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.149717 Aug 17 23:44:37.982096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 127/250] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:37 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:38.215954 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-49b08754-731f-4cda-8c53-7cc897fe6801 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:38.216517 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-49b08754-731f-4cda-8c53-7cc897fe6801 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:38.222369 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-49b08754-731f-4cda-8c53-7cc897fe6801 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:38.222841 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-49b08754-731f-4cda-8c53-7cc897fe6801 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:38.223267 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-49b08754-731f-4cda-8c53-7cc897fe6801 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:38.223940 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-49b08754-731f-4cda-8c53-7cc897fe6801 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:38.224408 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-49b08754-731f-4cda-8c53-7cc897fe6801 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:38.224822 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-49b08754-731f-4cda-8c53-7cc897fe6801 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:38.351805 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-49b08754-731f-4cda-8c53-7cc897fe6801 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:38.360183 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-49b08754-731f-4cda-8c53-7cc897fe6801 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:38.361681 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-49b08754-731f-4cda-8c53-7cc897fe6801 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:38.362765 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-49b08754-731f-4cda-8c53-7cc897fe6801 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.151099 Aug 17 23:44:38.363318 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 124/251] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:38 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:38.386431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-802fc92c-58c3-4384-b7d2-e975fe31d829 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:38.387043 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-802fc92c-58c3-4384-b7d2-e975fe31d829 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:38.393019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-802fc92c-58c3-4384-b7d2-e975fe31d829 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:38.393494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-802fc92c-58c3-4384-b7d2-e975fe31d829 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:38.393925 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-802fc92c-58c3-4384-b7d2-e975fe31d829 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:38.394604 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-802fc92c-58c3-4384-b7d2-e975fe31d829 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:38.395055 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-802fc92c-58c3-4384-b7d2-e975fe31d829 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:38.395472 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-802fc92c-58c3-4384-b7d2-e975fe31d829 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:38.525924 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-802fc92c-58c3-4384-b7d2-e975fe31d829 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:38.533262 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-802fc92c-58c3-4384-b7d2-e975fe31d829 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.150646 Aug 17 23:44:38.533822 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 128/252] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:38 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:38.635396 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f17d5aad-c9ce-4396-9592-ad08894f67fa tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:38.636025 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f17d5aad-c9ce-4396-9592-ad08894f67fa tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:38.641873 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f17d5aad-c9ce-4396-9592-ad08894f67fa tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:38.642346 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f17d5aad-c9ce-4396-9592-ad08894f67fa tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:38.642777 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f17d5aad-c9ce-4396-9592-ad08894f67fa tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:38.643451 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f17d5aad-c9ce-4396-9592-ad08894f67fa tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:38.643901 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f17d5aad-c9ce-4396-9592-ad08894f67fa tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:38.644345 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f17d5aad-c9ce-4396-9592-ad08894f67fa tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:38.770510 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f17d5aad-c9ce-4396-9592-ad08894f67fa tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:38.774058 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=100 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:44:38.779555 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f17d5aad-c9ce-4396-9592-ad08894f67fa tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.147929 Aug 17 23:44:38.780150 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 125/253] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:38 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:39.002289 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-21a06e67-05fb-499e-87ba-c5429c466eea tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:39.002907 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-21a06e67-05fb-499e-87ba-c5429c466eea tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:39.008770 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-21a06e67-05fb-499e-87ba-c5429c466eea tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:39.009759 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-21a06e67-05fb-499e-87ba-c5429c466eea tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:39.010201 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-21a06e67-05fb-499e-87ba-c5429c466eea tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:39.010886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-21a06e67-05fb-499e-87ba-c5429c466eea tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:39.011345 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-21a06e67-05fb-499e-87ba-c5429c466eea tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:39.011774 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-21a06e67-05fb-499e-87ba-c5429c466eea tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:39.141231 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-21a06e67-05fb-499e-87ba-c5429c466eea tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:39.148593 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-21a06e67-05fb-499e-87ba-c5429c466eea tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.150211 Aug 17 23:44:39.149141 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 129/254] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:38 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:39.385720 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9c179312-ef58-4653-bcbb-06d344344740 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:39.386232 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9c179312-ef58-4653-bcbb-06d344344740 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:39.392319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9c179312-ef58-4653-bcbb-06d344344740 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:39.392801 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9c179312-ef58-4653-bcbb-06d344344740 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:39.393242 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9c179312-ef58-4653-bcbb-06d344344740 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:39.393924 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9c179312-ef58-4653-bcbb-06d344344740 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:39.394377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9c179312-ef58-4653-bcbb-06d344344740 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:39.394801 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9c179312-ef58-4653-bcbb-06d344344740 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:39.522945 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9c179312-ef58-4653-bcbb-06d344344740 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:39.531007 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9c179312-ef58-4653-bcbb-06d344344740 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:39.532561 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9c179312-ef58-4653-bcbb-06d344344740 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:39.533655 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9c179312-ef58-4653-bcbb-06d344344740 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.152557 Aug 17 23:44:39.534208 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 126/255] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:39 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:39.554583 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-78d815fe-ca14-4ee2-9b9b-0efc3129ea2a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:39.555191 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-78d815fe-ca14-4ee2-9b9b-0efc3129ea2a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:39.561678 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-78d815fe-ca14-4ee2-9b9b-0efc3129ea2a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:39.562151 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-78d815fe-ca14-4ee2-9b9b-0efc3129ea2a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:39.562696 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-78d815fe-ca14-4ee2-9b9b-0efc3129ea2a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:39.563375 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-78d815fe-ca14-4ee2-9b9b-0efc3129ea2a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:39.563824 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-78d815fe-ca14-4ee2-9b9b-0efc3129ea2a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:39.564274 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-78d815fe-ca14-4ee2-9b9b-0efc3129ea2a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:39.691296 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-78d815fe-ca14-4ee2-9b9b-0efc3129ea2a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:39.698539 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-78d815fe-ca14-4ee2-9b9b-0efc3129ea2a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.147758 Aug 17 23:44:39.699097 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 130/256] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:39 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:39.800624 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-7dde60f2-41e1-4e46-a6a2-9f4b0afe43f3 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:39.801235 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-7dde60f2-41e1-4e46-a6a2-9f4b0afe43f3 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:39.807710 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7dde60f2-41e1-4e46-a6a2-9f4b0afe43f3 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:39.808219 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7dde60f2-41e1-4e46-a6a2-9f4b0afe43f3 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:39.808657 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7dde60f2-41e1-4e46-a6a2-9f4b0afe43f3 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:39.809342 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7dde60f2-41e1-4e46-a6a2-9f4b0afe43f3 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:39.809798 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7dde60f2-41e1-4e46-a6a2-9f4b0afe43f3 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:39.810219 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7dde60f2-41e1-4e46-a6a2-9f4b0afe43f3 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:39.932715 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7dde60f2-41e1-4e46-a6a2-9f4b0afe43f3 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:39.940002 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-7dde60f2-41e1-4e46-a6a2-9f4b0afe43f3 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.143105 Aug 17 23:44:39.940567 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 127/257] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:39 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:40.170049 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-717b1d26-f728-4ac5-ba91-994d6cb7a13c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:40.170659 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-717b1d26-f728-4ac5-ba91-994d6cb7a13c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:40.176458 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-717b1d26-f728-4ac5-ba91-994d6cb7a13c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:40.176929 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-717b1d26-f728-4ac5-ba91-994d6cb7a13c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:40.177354 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-717b1d26-f728-4ac5-ba91-994d6cb7a13c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:40.178028 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-717b1d26-f728-4ac5-ba91-994d6cb7a13c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:40.178474 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-717b1d26-f728-4ac5-ba91-994d6cb7a13c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:40.178895 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-717b1d26-f728-4ac5-ba91-994d6cb7a13c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:40.305161 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-717b1d26-f728-4ac5-ba91-994d6cb7a13c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:40.312458 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-717b1d26-f728-4ac5-ba91-994d6cb7a13c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.146911 Aug 17 23:44:40.313015 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 131/258] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:40 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:40.556521 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b5ace436-5568-4787-87bc-dcc82fa0ef2e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:40.557124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b5ace436-5568-4787-87bc-dcc82fa0ef2e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:40.558988 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=100 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:44:40.564229 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b5ace436-5568-4787-87bc-dcc82fa0ef2e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:40.564739 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b5ace436-5568-4787-87bc-dcc82fa0ef2e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:40.565166 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b5ace436-5568-4787-87bc-dcc82fa0ef2e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:40.565841 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b5ace436-5568-4787-87bc-dcc82fa0ef2e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:40.566290 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b5ace436-5568-4787-87bc-dcc82fa0ef2e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:40.566705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b5ace436-5568-4787-87bc-dcc82fa0ef2e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:40.692397 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b5ace436-5568-4787-87bc-dcc82fa0ef2e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:40.700807 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b5ace436-5568-4787-87bc-dcc82fa0ef2e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:40.702294 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b5ace436-5568-4787-87bc-dcc82fa0ef2e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:40.703382 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b5ace436-5568-4787-87bc-dcc82fa0ef2e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.150724 Aug 17 23:44:40.703971 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 128/259] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:40 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:40.718473 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f2c50652-84f4-41a8-8b1a-5fdcd9fc0570 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:40.719082 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f2c50652-84f4-41a8-8b1a-5fdcd9fc0570 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:40.725102 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2c50652-84f4-41a8-8b1a-5fdcd9fc0570 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:40.725593 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2c50652-84f4-41a8-8b1a-5fdcd9fc0570 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:40.726031 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2c50652-84f4-41a8-8b1a-5fdcd9fc0570 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:40.726748 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2c50652-84f4-41a8-8b1a-5fdcd9fc0570 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:40.727205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2c50652-84f4-41a8-8b1a-5fdcd9fc0570 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:40.727631 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2c50652-84f4-41a8-8b1a-5fdcd9fc0570 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:40.854403 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f2c50652-84f4-41a8-8b1a-5fdcd9fc0570 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:40.861763 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f2c50652-84f4-41a8-8b1a-5fdcd9fc0570 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.147062 Aug 17 23:44:40.862325 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 132/260] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:40 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:40.960432 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-26692306-f223-4ec0-ae52-10433ffb7a8c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:40.961192 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-26692306-f223-4ec0-ae52-10433ffb7a8c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:40.967253 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-26692306-f223-4ec0-ae52-10433ffb7a8c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:40.967737 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-26692306-f223-4ec0-ae52-10433ffb7a8c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:40.968238 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-26692306-f223-4ec0-ae52-10433ffb7a8c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:40.968973 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-26692306-f223-4ec0-ae52-10433ffb7a8c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:40.969375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-26692306-f223-4ec0-ae52-10433ffb7a8c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:40.969914 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-26692306-f223-4ec0-ae52-10433ffb7a8c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:41.101514 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-26692306-f223-4ec0-ae52-10433ffb7a8c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:41.109280 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-26692306-f223-4ec0-ae52-10433ffb7a8c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.152657 Aug 17 23:44:41.109832 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 129/261] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:40 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:41.332985 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b3a676a5-4e36-452d-9051-ce03a4a68654 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:41.333592 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b3a676a5-4e36-452d-9051-ce03a4a68654 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:41.340010 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b3a676a5-4e36-452d-9051-ce03a4a68654 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:41.340523 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b3a676a5-4e36-452d-9051-ce03a4a68654 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:41.340961 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b3a676a5-4e36-452d-9051-ce03a4a68654 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:41.341637 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b3a676a5-4e36-452d-9051-ce03a4a68654 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:41.342089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b3a676a5-4e36-452d-9051-ce03a4a68654 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:41.342509 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b3a676a5-4e36-452d-9051-ce03a4a68654 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:41.471181 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b3a676a5-4e36-452d-9051-ce03a4a68654 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:41.478551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b3a676a5-4e36-452d-9051-ce03a4a68654 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.149343 Aug 17 23:44:41.479061 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 133/262] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:41 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:41.724962 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-21d23023-5053-4997-8c12-59dc0760216f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:41.725568 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-21d23023-5053-4997-8c12-59dc0760216f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:41.731454 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-21d23023-5053-4997-8c12-59dc0760216f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:41.731870 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-21d23023-5053-4997-8c12-59dc0760216f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:41.732413 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-21d23023-5053-4997-8c12-59dc0760216f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:41.733091 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-21d23023-5053-4997-8c12-59dc0760216f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:41.733539 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-21d23023-5053-4997-8c12-59dc0760216f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:41.733960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-21d23023-5053-4997-8c12-59dc0760216f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:41.858729 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-21d23023-5053-4997-8c12-59dc0760216f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:41.867003 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-21d23023-5053-4997-8c12-59dc0760216f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:41.868570 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-21d23023-5053-4997-8c12-59dc0760216f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:41.869666 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-21d23023-5053-4997-8c12-59dc0760216f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.148730 Aug 17 23:44:41.870236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 130/263] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:41 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:41.882406 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-eaf906d1-5507-442c-b9bf-1088dbf12c8e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:41.883021 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-eaf906d1-5507-442c-b9bf-1088dbf12c8e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:41.889524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-eaf906d1-5507-442c-b9bf-1088dbf12c8e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:41.890001 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-eaf906d1-5507-442c-b9bf-1088dbf12c8e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:41.890434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-eaf906d1-5507-442c-b9bf-1088dbf12c8e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:41.891169 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-eaf906d1-5507-442c-b9bf-1088dbf12c8e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:41.891619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-eaf906d1-5507-442c-b9bf-1088dbf12c8e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:41.892060 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-eaf906d1-5507-442c-b9bf-1088dbf12c8e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:42.016408 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-eaf906d1-5507-442c-b9bf-1088dbf12c8e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:42.023679 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-eaf906d1-5507-442c-b9bf-1088dbf12c8e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.145100 Aug 17 23:44:42.024296 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 134/264] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:41 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:42.129981 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-dbae4dbc-9577-49e0-bf93-8e06a78fac4f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:42.130682 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-dbae4dbc-9577-49e0-bf93-8e06a78fac4f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:42.136594 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dbae4dbc-9577-49e0-bf93-8e06a78fac4f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:42.137765 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dbae4dbc-9577-49e0-bf93-8e06a78fac4f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:42.138196 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dbae4dbc-9577-49e0-bf93-8e06a78fac4f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:42.138883 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dbae4dbc-9577-49e0-bf93-8e06a78fac4f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:42.139315 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dbae4dbc-9577-49e0-bf93-8e06a78fac4f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:42.139729 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dbae4dbc-9577-49e0-bf93-8e06a78fac4f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:42.268217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-dbae4dbc-9577-49e0-bf93-8e06a78fac4f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:42.275495 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-dbae4dbc-9577-49e0-bf93-8e06a78fac4f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.149308 Aug 17 23:44:42.276069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 131/265] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:42 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:42.499621 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8e7db8f4-56ab-4a05-884e-b0d41f7f4fb1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:42.500337 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8e7db8f4-56ab-4a05-884e-b0d41f7f4fb1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:42.506122 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8e7db8f4-56ab-4a05-884e-b0d41f7f4fb1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:42.506590 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8e7db8f4-56ab-4a05-884e-b0d41f7f4fb1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:42.507023 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8e7db8f4-56ab-4a05-884e-b0d41f7f4fb1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:42.507697 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8e7db8f4-56ab-4a05-884e-b0d41f7f4fb1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:42.508183 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8e7db8f4-56ab-4a05-884e-b0d41f7f4fb1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:42.508601 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8e7db8f4-56ab-4a05-884e-b0d41f7f4fb1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:42.640263 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-8e7db8f4-56ab-4a05-884e-b0d41f7f4fb1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:42.647561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8e7db8f4-56ab-4a05-884e-b0d41f7f4fb1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.152324 Aug 17 23:44:42.648152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 135/266] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:42 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:42.890749 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2b097587-c37c-4b1e-bac7-71752fd1fa2f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:42.891353 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2b097587-c37c-4b1e-bac7-71752fd1fa2f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:42.897458 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2b097587-c37c-4b1e-bac7-71752fd1fa2f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:42.897933 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2b097587-c37c-4b1e-bac7-71752fd1fa2f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:42.898365 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2b097587-c37c-4b1e-bac7-71752fd1fa2f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:42.899356 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2b097587-c37c-4b1e-bac7-71752fd1fa2f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:42.899491 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2b097587-c37c-4b1e-bac7-71752fd1fa2f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:42.899907 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2b097587-c37c-4b1e-bac7-71752fd1fa2f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:43.025538 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2b097587-c37c-4b1e-bac7-71752fd1fa2f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:43.033895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2b097587-c37c-4b1e-bac7-71752fd1fa2f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:43.035654 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2b097587-c37c-4b1e-bac7-71752fd1fa2f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:43.036770 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2b097587-c37c-4b1e-bac7-71752fd1fa2f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.149828 Aug 17 23:44:43.037327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 132/267] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:42 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:43.045680 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-33821b81-2083-48d0-84fb-58a14ddd98a4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:43.046317 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-33821b81-2083-48d0-84fb-58a14ddd98a4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:43.052494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-33821b81-2083-48d0-84fb-58a14ddd98a4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:43.053001 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-33821b81-2083-48d0-84fb-58a14ddd98a4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:43.053434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-33821b81-2083-48d0-84fb-58a14ddd98a4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:43.054115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-33821b81-2083-48d0-84fb-58a14ddd98a4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:43.054567 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-33821b81-2083-48d0-84fb-58a14ddd98a4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:43.054984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-33821b81-2083-48d0-84fb-58a14ddd98a4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:43.072575 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=100 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:44:43.181724 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-33821b81-2083-48d0-84fb-58a14ddd98a4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:43.189137 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-33821b81-2083-48d0-84fb-58a14ddd98a4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.147865 Aug 17 23:44:43.189700 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 136/268] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:43 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:43.296230 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0f17bc52-039b-4d2d-965c-f48a5b209e22 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:43.296835 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0f17bc52-039b-4d2d-965c-f48a5b209e22 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:43.303027 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0f17bc52-039b-4d2d-965c-f48a5b209e22 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:43.303512 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0f17bc52-039b-4d2d-965c-f48a5b209e22 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:43.303946 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0f17bc52-039b-4d2d-965c-f48a5b209e22 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:43.304644 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0f17bc52-039b-4d2d-965c-f48a5b209e22 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:43.305097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0f17bc52-039b-4d2d-965c-f48a5b209e22 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:43.305515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0f17bc52-039b-4d2d-965c-f48a5b209e22 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:43.429522 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0f17bc52-039b-4d2d-965c-f48a5b209e22 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:43.436767 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0f17bc52-039b-4d2d-965c-f48a5b209e22 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.144476 Aug 17 23:44:43.437329 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 133/269] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:43 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:43.668370 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e78b3a7b-1271-4268-a118-cce3bddf3c7d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:43.668896 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e78b3a7b-1271-4268-a118-cce3bddf3c7d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:43.674803 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e78b3a7b-1271-4268-a118-cce3bddf3c7d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:43.675277 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e78b3a7b-1271-4268-a118-cce3bddf3c7d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:43.675704 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e78b3a7b-1271-4268-a118-cce3bddf3c7d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:43.676405 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e78b3a7b-1271-4268-a118-cce3bddf3c7d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:43.676855 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e78b3a7b-1271-4268-a118-cce3bddf3c7d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:43.677274 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e78b3a7b-1271-4268-a118-cce3bddf3c7d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:43.801430 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e78b3a7b-1271-4268-a118-cce3bddf3c7d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:43.809401 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e78b3a7b-1271-4268-a118-cce3bddf3c7d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.144402 Aug 17 23:44:43.809964 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 137/270] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:43 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:44.059820 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-63838c28-f8ee-45f0-be02-b0245f1f67b9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:44.060458 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-63838c28-f8ee-45f0-be02-b0245f1f67b9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:44.066350 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-63838c28-f8ee-45f0-be02-b0245f1f67b9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:44.066834 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-63838c28-f8ee-45f0-be02-b0245f1f67b9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:44.067272 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-63838c28-f8ee-45f0-be02-b0245f1f67b9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:44.067979 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-63838c28-f8ee-45f0-be02-b0245f1f67b9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:44.068439 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-63838c28-f8ee-45f0-be02-b0245f1f67b9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:44.068866 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-63838c28-f8ee-45f0-be02-b0245f1f67b9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:44.203021 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-63838c28-f8ee-45f0-be02-b0245f1f67b9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:44.210077 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-43ef8240-1240-438c-8261-91dfaf3a9c9c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:44.210697 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-43ef8240-1240-438c-8261-91dfaf3a9c9c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:44.211086 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-63838c28-f8ee-45f0-be02-b0245f1f67b9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:44.212869 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-63838c28-f8ee-45f0-be02-b0245f1f67b9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:44.214427 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-63838c28-f8ee-45f0-be02-b0245f1f67b9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.159025 Aug 17 23:44:44.224058 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 134/271] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:44 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:44.224224 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-43ef8240-1240-438c-8261-91dfaf3a9c9c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:44.224224 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-43ef8240-1240-438c-8261-91dfaf3a9c9c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:44.224224 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-43ef8240-1240-438c-8261-91dfaf3a9c9c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:44.224224 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-43ef8240-1240-438c-8261-91dfaf3a9c9c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:44.224515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-43ef8240-1240-438c-8261-91dfaf3a9c9c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:44.224515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-43ef8240-1240-438c-8261-91dfaf3a9c9c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:44.364921 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-43ef8240-1240-438c-8261-91dfaf3a9c9c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:44.372396 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-43ef8240-1240-438c-8261-91dfaf3a9c9c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1368 microversion: 2.1 time: 0.166188 Aug 17 23:44:44.372964 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 138/272] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:44 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:44.458468 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5955fac9-01ac-4260-8d09-f86a28c2d0c5 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:44.459189 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5955fac9-01ac-4260-8d09-f86a28c2d0c5 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:44.465636 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5955fac9-01ac-4260-8d09-f86a28c2d0c5 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:44.466115 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5955fac9-01ac-4260-8d09-f86a28c2d0c5 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:44.466568 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5955fac9-01ac-4260-8d09-f86a28c2d0c5 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:44.467228 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5955fac9-01ac-4260-8d09-f86a28c2d0c5 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:44.467681 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5955fac9-01ac-4260-8d09-f86a28c2d0c5 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:44.468130 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5955fac9-01ac-4260-8d09-f86a28c2d0c5 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:44.592870 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5955fac9-01ac-4260-8d09-f86a28c2d0c5 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:44.600119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5955fac9-01ac-4260-8d09-f86a28c2d0c5 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.145690 Aug 17 23:44:44.600678 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 135/273] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:44 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:44.829617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-56c3a86c-39b9-4985-8f14-5714d5e9aa89 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:44.830263 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-56c3a86c-39b9-4985-8f14-5714d5e9aa89 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:44.836120 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-56c3a86c-39b9-4985-8f14-5714d5e9aa89 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:44.836606 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-56c3a86c-39b9-4985-8f14-5714d5e9aa89 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:44.837044 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-56c3a86c-39b9-4985-8f14-5714d5e9aa89 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:44.837725 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-56c3a86c-39b9-4985-8f14-5714d5e9aa89 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:44.838183 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-56c3a86c-39b9-4985-8f14-5714d5e9aa89 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:44.838610 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-56c3a86c-39b9-4985-8f14-5714d5e9aa89 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:44.964092 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-56c3a86c-39b9-4985-8f14-5714d5e9aa89 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:44.972015 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-56c3a86c-39b9-4985-8f14-5714d5e9aa89 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.146209 Aug 17 23:44:44.972586 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 139/274] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:44 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:45.239179 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1d8e38c7-0eed-42b8-aca5-14ce992476d4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:45.239823 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-1d8e38c7-0eed-42b8-aca5-14ce992476d4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:45.245732 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1d8e38c7-0eed-42b8-aca5-14ce992476d4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:45.246732 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1d8e38c7-0eed-42b8-aca5-14ce992476d4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:45.247172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1d8e38c7-0eed-42b8-aca5-14ce992476d4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:45.247883 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1d8e38c7-0eed-42b8-aca5-14ce992476d4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:45.248383 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1d8e38c7-0eed-42b8-aca5-14ce992476d4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:45.248806 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1d8e38c7-0eed-42b8-aca5-14ce992476d4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:45.393789 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ca09b564-2d31-44f9-a92a-79c48a9b2d46 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:45.394410 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ca09b564-2d31-44f9-a92a-79c48a9b2d46 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:45.400299 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1d8e38c7-0eed-42b8-aca5-14ce992476d4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:45.400543 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ca09b564-2d31-44f9-a92a-79c48a9b2d46 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:45.401519 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ca09b564-2d31-44f9-a92a-79c48a9b2d46 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:45.402167 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ca09b564-2d31-44f9-a92a-79c48a9b2d46 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:45.403140 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ca09b564-2d31-44f9-a92a-79c48a9b2d46 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:45.403808 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ca09b564-2d31-44f9-a92a-79c48a9b2d46 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:45.404689 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ca09b564-2d31-44f9-a92a-79c48a9b2d46 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:45.411265 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1d8e38c7-0eed-42b8-aca5-14ce992476d4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:45.412859 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1d8e38c7-0eed-42b8-aca5-14ce992476d4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:45.413990 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-1d8e38c7-0eed-42b8-aca5-14ce992476d4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.178678 Aug 17 23:44:45.427490 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 136/275] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:45 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:45.582560 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ca09b564-2d31-44f9-a92a-79c48a9b2d46 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:45.592178 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ca09b564-2d31-44f9-a92a-79c48a9b2d46 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1558 microversion: 2.1 time: 0.202249 Aug 17 23:44:45.593883 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 140/276] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:45 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1558 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:45.615806 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-78e0a62d-0599-408c-8623-97f6792a4dc3 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:45.623182 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-92104b08-9c49-4528-921d-3ee5f4f48592 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:45.623823 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-92104b08-9c49-4528-921d-3ee5f4f48592 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:45.624668 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-78e0a62d-0599-408c-8623-97f6792a4dc3 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:45.634946 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-78e0a62d-0599-408c-8623-97f6792a4dc3 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:45.635446 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-78e0a62d-0599-408c-8623-97f6792a4dc3 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:45.635876 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-78e0a62d-0599-408c-8623-97f6792a4dc3 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:45.637807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-92104b08-9c49-4528-921d-3ee5f4f48592 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:45.638470 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-92104b08-9c49-4528-921d-3ee5f4f48592 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:45.639340 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-78e0a62d-0599-408c-8623-97f6792a4dc3 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:45.640491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-92104b08-9c49-4528-921d-3ee5f4f48592 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:45.646312 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-78e0a62d-0599-408c-8623-97f6792a4dc3 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:45.646521 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-92104b08-9c49-4528-921d-3ee5f4f48592 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:45.647458 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-78e0a62d-0599-408c-8623-97f6792a4dc3 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:45.648153 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-92104b08-9c49-4528-921d-3ee5f4f48592 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:45.652394 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-92104b08-9c49-4528-921d-3ee5f4f48592 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:45.780448 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-78e0a62d-0599-408c-8623-97f6792a4dc3 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.169734 Aug 17 23:44:45.781393 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 137/277] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Aug 17 23:44:45 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73/os-interface => generated 285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:44:45.791777 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-92104b08-9c49-4528-921d-3ee5f4f48592 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:45.799681 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-92104b08-9c49-4528-921d-3ee5f4f48592 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.182516 Aug 17 23:44:45.800268 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 141/278] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:45 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:45.992760 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3f52d085-648f-411f-9e34-64285d3ac795 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:45.993371 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3f52d085-648f-411f-9e34-64285d3ac795 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:45.999387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3f52d085-648f-411f-9e34-64285d3ac795 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:45.999872 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3f52d085-648f-411f-9e34-64285d3ac795 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:46.000331 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3f52d085-648f-411f-9e34-64285d3ac795 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:46.001019 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3f52d085-648f-411f-9e34-64285d3ac795 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:46.001472 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3f52d085-648f-411f-9e34-64285d3ac795 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:46.001896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3f52d085-648f-411f-9e34-64285d3ac795 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:46.440033 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-692d6972-cd1a-4132-8689-c55a9ee6675a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:46.440749 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-692d6972-cd1a-4132-8689-c55a9ee6675a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:46.446896 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-692d6972-cd1a-4132-8689-c55a9ee6675a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:46.447380 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-692d6972-cd1a-4132-8689-c55a9ee6675a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:46.447813 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-692d6972-cd1a-4132-8689-c55a9ee6675a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:46.448527 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-692d6972-cd1a-4132-8689-c55a9ee6675a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:46.448975 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-692d6972-cd1a-4132-8689-c55a9ee6675a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:46.449899 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-692d6972-cd1a-4132-8689-c55a9ee6675a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:46.474319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3f52d085-648f-411f-9e34-64285d3ac795 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:46.482056 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3f52d085-648f-411f-9e34-64285d3ac795 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.493289 Aug 17 23:44:46.482635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 138/279] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:45 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:46.582976 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-692d6972-cd1a-4132-8689-c55a9ee6675a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:46.590963 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-692d6972-cd1a-4132-8689-c55a9ee6675a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:46.592573 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-692d6972-cd1a-4132-8689-c55a9ee6675a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:46.593740 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-692d6972-cd1a-4132-8689-c55a9ee6675a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.157643 Aug 17 23:44:46.594583 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 142/280] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:46 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:44:46.820415 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e67a2cce-2437-4b8f-b4b5-66f9ec9f88ff tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:46.821036 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e67a2cce-2437-4b8f-b4b5-66f9ec9f88ff tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:46.827603 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e67a2cce-2437-4b8f-b4b5-66f9ec9f88ff tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:46.828121 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e67a2cce-2437-4b8f-b4b5-66f9ec9f88ff tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:46.828562 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e67a2cce-2437-4b8f-b4b5-66f9ec9f88ff tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:46.829265 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e67a2cce-2437-4b8f-b4b5-66f9ec9f88ff tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:46.829722 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e67a2cce-2437-4b8f-b4b5-66f9ec9f88ff tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:46.830213 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e67a2cce-2437-4b8f-b4b5-66f9ec9f88ff tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:47.066216 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e67a2cce-2437-4b8f-b4b5-66f9ec9f88ff tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:47.073433 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e67a2cce-2437-4b8f-b4b5-66f9ec9f88ff tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.256884 Aug 17 23:44:47.074030 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 139/281] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:46 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:47.234127 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-d06d9e00-8028-4823-a4a7-31cfa985deb9 req-34ab5539-2971-45bd-98e1-83e5a4447112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d619bf9d-15c1-4cef-bcc3-4a792878bf73", "tag": "f60e9126-8ff5-4a1e-bdee-fcf39e05162b"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:44:47.243377 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-d06d9e00-8028-4823-a4a7-31cfa985deb9 req-34ab5539-2971-45bd-98e1-83e5a4447112 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:47.243831 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-d06d9e00-8028-4823-a4a7-31cfa985deb9 req-34ab5539-2971-45bd-98e1-83e5a4447112 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:47.244287 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-d06d9e00-8028-4823-a4a7-31cfa985deb9 req-34ab5539-2971-45bd-98e1-83e5a4447112 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:47.256658 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-d06d9e00-8028-4823-a4a7-31cfa985deb9 req-34ab5539-2971-45bd-98e1-83e5a4447112 service nova] Creating event network-changed:f60e9126-8ff5-4a1e-bdee-fcf39e05162b for instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 on hv-cinder-82002 Aug 17 23:44:47.262030 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-d06d9e00-8028-4823-a4a7-31cfa985deb9 req-34ab5539-2971-45bd-98e1-83e5a4447112 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032090 Aug 17 23:44:47.262632 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 143/282] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:44:47.501796 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ef412bdc-fbad-40d9-a5d4-434501639d46 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:47.502408 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ef412bdc-fbad-40d9-a5d4-434501639d46 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:47.508408 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ef412bdc-fbad-40d9-a5d4-434501639d46 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:47.508889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ef412bdc-fbad-40d9-a5d4-434501639d46 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:47.509320 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ef412bdc-fbad-40d9-a5d4-434501639d46 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:47.510008 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ef412bdc-fbad-40d9-a5d4-434501639d46 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:47.510457 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ef412bdc-fbad-40d9-a5d4-434501639d46 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:47.510877 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ef412bdc-fbad-40d9-a5d4-434501639d46 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:47.616008 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f4b8a78f-1eb6-4d72-a438-fd998f5b4e82 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:47.617384 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f4b8a78f-1eb6-4d72-a438-fd998f5b4e82 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:47.624539 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f4b8a78f-1eb6-4d72-a438-fd998f5b4e82 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:47.625106 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f4b8a78f-1eb6-4d72-a438-fd998f5b4e82 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:47.625782 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f4b8a78f-1eb6-4d72-a438-fd998f5b4e82 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:47.626774 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f4b8a78f-1eb6-4d72-a438-fd998f5b4e82 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:47.627303 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f4b8a78f-1eb6-4d72-a438-fd998f5b4e82 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:47.627812 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f4b8a78f-1eb6-4d72-a438-fd998f5b4e82 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:47.646268 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ef412bdc-fbad-40d9-a5d4-434501639d46 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:47.654739 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ef412bdc-fbad-40d9-a5d4-434501639d46 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.156690 Aug 17 23:44:47.655721 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 140/283] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:47 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:47.776364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f4b8a78f-1eb6-4d72-a438-fd998f5b4e82 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:47.784778 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f4b8a78f-1eb6-4d72-a438-fd998f5b4e82 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:47.786631 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f4b8a78f-1eb6-4d72-a438-fd998f5b4e82 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:47.787811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f4b8a78f-1eb6-4d72-a438-fd998f5b4e82 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.176088 Aug 17 23:44:47.788489 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 144/284] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:47 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:48.094095 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3f8d4c30-f99c-44b9-ad26-e0d4ef32177c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:48.094735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3f8d4c30-f99c-44b9-ad26-e0d4ef32177c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:48.100778 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3f8d4c30-f99c-44b9-ad26-e0d4ef32177c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:48.101263 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3f8d4c30-f99c-44b9-ad26-e0d4ef32177c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:48.101696 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3f8d4c30-f99c-44b9-ad26-e0d4ef32177c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:48.102385 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3f8d4c30-f99c-44b9-ad26-e0d4ef32177c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:48.102840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3f8d4c30-f99c-44b9-ad26-e0d4ef32177c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:48.103256 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3f8d4c30-f99c-44b9-ad26-e0d4ef32177c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:48.240418 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3f8d4c30-f99c-44b9-ad26-e0d4ef32177c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:48.248161 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3f8d4c30-f99c-44b9-ad26-e0d4ef32177c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.158184 Aug 17 23:44:48.248935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 141/285] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:48 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:48.676663 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a6891b66-0dc4-4402-9b28-26b35b81e004 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:48.677290 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a6891b66-0dc4-4402-9b28-26b35b81e004 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:48.683182 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a6891b66-0dc4-4402-9b28-26b35b81e004 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:48.683670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a6891b66-0dc4-4402-9b28-26b35b81e004 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:48.684161 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a6891b66-0dc4-4402-9b28-26b35b81e004 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:48.684850 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a6891b66-0dc4-4402-9b28-26b35b81e004 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:48.685310 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a6891b66-0dc4-4402-9b28-26b35b81e004 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:48.685739 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a6891b66-0dc4-4402-9b28-26b35b81e004 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:48.811253 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-201283ec-0562-431a-8183-28dea1377dcc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:48.811810 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-201283ec-0562-431a-8183-28dea1377dcc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:48.818197 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-201283ec-0562-431a-8183-28dea1377dcc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:48.818689 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-201283ec-0562-431a-8183-28dea1377dcc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:48.819365 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-201283ec-0562-431a-8183-28dea1377dcc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:48.820249 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-201283ec-0562-431a-8183-28dea1377dcc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:48.820856 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-201283ec-0562-431a-8183-28dea1377dcc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:48.821429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-201283ec-0562-431a-8183-28dea1377dcc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:48.840384 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a6891b66-0dc4-4402-9b28-26b35b81e004 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:48.851887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a6891b66-0dc4-4402-9b28-26b35b81e004 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.179058 Aug 17 23:44:48.856329 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 145/286] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:48 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:48.965539 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-201283ec-0562-431a-8183-28dea1377dcc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:48.969006 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=100 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:44:48.974268 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-201283ec-0562-431a-8183-28dea1377dcc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:48.975774 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-201283ec-0562-431a-8183-28dea1377dcc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:48.976905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-201283ec-0562-431a-8183-28dea1377dcc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.170123 Aug 17 23:44:48.977490 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 142/287] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:48 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:49.268737 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f8ce0090-f1ff-472c-ab26-fca9c92d4a1b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:49.269340 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f8ce0090-f1ff-472c-ab26-fca9c92d4a1b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:49.271512 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=100 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:44:49.276948 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f8ce0090-f1ff-472c-ab26-fca9c92d4a1b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:49.277427 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f8ce0090-f1ff-472c-ab26-fca9c92d4a1b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:49.277860 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f8ce0090-f1ff-472c-ab26-fca9c92d4a1b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:49.278541 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f8ce0090-f1ff-472c-ab26-fca9c92d4a1b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:49.278990 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f8ce0090-f1ff-472c-ab26-fca9c92d4a1b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:49.279406 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f8ce0090-f1ff-472c-ab26-fca9c92d4a1b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:49.409267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f8ce0090-f1ff-472c-ab26-fca9c92d4a1b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:49.416858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f8ce0090-f1ff-472c-ab26-fca9c92d4a1b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.151927 Aug 17 23:44:49.417442 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 146/288] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:49 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:49.876359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-35bb20e8-9b25-4465-8413-fe8650e6ea20 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:49.876991 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-35bb20e8-9b25-4465-8413-fe8650e6ea20 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:49.883054 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-35bb20e8-9b25-4465-8413-fe8650e6ea20 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:49.884199 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-35bb20e8-9b25-4465-8413-fe8650e6ea20 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:49.884631 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-35bb20e8-9b25-4465-8413-fe8650e6ea20 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:49.885333 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-35bb20e8-9b25-4465-8413-fe8650e6ea20 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:49.885784 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-35bb20e8-9b25-4465-8413-fe8650e6ea20 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:49.886198 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-35bb20e8-9b25-4465-8413-fe8650e6ea20 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:49.998662 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-35442ddb-2cfb-4dbe-b531-e7a3b9e4f976 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:49.999399 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-35442ddb-2cfb-4dbe-b531-e7a3b9e4f976 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:50.005188 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-35442ddb-2cfb-4dbe-b531-e7a3b9e4f976 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:50.005663 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-35442ddb-2cfb-4dbe-b531-e7a3b9e4f976 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:50.006099 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-35442ddb-2cfb-4dbe-b531-e7a3b9e4f976 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:50.006775 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-35442ddb-2cfb-4dbe-b531-e7a3b9e4f976 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:50.007221 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-35442ddb-2cfb-4dbe-b531-e7a3b9e4f976 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:50.007637 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-35442ddb-2cfb-4dbe-b531-e7a3b9e4f976 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:50.011194 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-35bb20e8-9b25-4465-8413-fe8650e6ea20 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:50.019131 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-35bb20e8-9b25-4465-8413-fe8650e6ea20 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1322 microversion: 2.1 time: 0.146756 Aug 17 23:44:50.019732 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 143/289] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:49 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:50.135883 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-35442ddb-2cfb-4dbe-b531-e7a3b9e4f976 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:50.144553 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-35442ddb-2cfb-4dbe-b531-e7a3b9e4f976 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:50.146045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-35442ddb-2cfb-4dbe-b531-e7a3b9e4f976 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:50.147124 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-35442ddb-2cfb-4dbe-b531-e7a3b9e4f976 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.152325 Aug 17 23:44:50.147679 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 147/290] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:49 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:44:50.438578 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f53d0e3b-f7ef-48aa-a4c7-ecb325780d3b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:50.439138 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f53d0e3b-f7ef-48aa-a4c7-ecb325780d3b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:50.445059 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f53d0e3b-f7ef-48aa-a4c7-ecb325780d3b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:50.445548 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f53d0e3b-f7ef-48aa-a4c7-ecb325780d3b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:50.445986 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f53d0e3b-f7ef-48aa-a4c7-ecb325780d3b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:50.446672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f53d0e3b-f7ef-48aa-a4c7-ecb325780d3b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:50.447132 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f53d0e3b-f7ef-48aa-a4c7-ecb325780d3b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:50.447551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f53d0e3b-f7ef-48aa-a4c7-ecb325780d3b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:50.589971 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f53d0e3b-f7ef-48aa-a4c7-ecb325780d3b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:50.597338 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f53d0e3b-f7ef-48aa-a4c7-ecb325780d3b tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.162673 Aug 17 23:44:50.597896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 144/291] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:50 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:44:51.040514 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-039b78bb-5085-4bc5-9c40-82d04104ddee tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:51.041152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-039b78bb-5085-4bc5-9c40-82d04104ddee tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:51.047712 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-039b78bb-5085-4bc5-9c40-82d04104ddee tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:51.048242 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-039b78bb-5085-4bc5-9c40-82d04104ddee tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:51.048693 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-039b78bb-5085-4bc5-9c40-82d04104ddee tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:51.049379 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-039b78bb-5085-4bc5-9c40-82d04104ddee tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:51.049850 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-039b78bb-5085-4bc5-9c40-82d04104ddee tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:51.050269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-039b78bb-5085-4bc5-9c40-82d04104ddee tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:51.170443 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-4c19f321-ff1e-4bf1-a600-663024b74e8d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:51.171156 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-4c19f321-ff1e-4bf1-a600-663024b74e8d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:51.177417 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4c19f321-ff1e-4bf1-a600-663024b74e8d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:51.177903 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4c19f321-ff1e-4bf1-a600-663024b74e8d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:51.178354 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4c19f321-ff1e-4bf1-a600-663024b74e8d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:51.179208 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4c19f321-ff1e-4bf1-a600-663024b74e8d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:51.179658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4c19f321-ff1e-4bf1-a600-663024b74e8d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:51.180104 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4c19f321-ff1e-4bf1-a600-663024b74e8d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:51.185918 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-039b78bb-5085-4bc5-9c40-82d04104ddee tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:51.193685 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-039b78bb-5085-4bc5-9c40-82d04104ddee tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1517 microversion: 2.1 time: 0.157007 Aug 17 23:44:51.195999 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 148/292] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:51 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:51.215925 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f715d66f-bc20-4006-9849-cf37f321dc14 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:44:51.218242 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f715d66f-bc20-4006-9849-cf37f321dc14 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:51.224434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f715d66f-bc20-4006-9849-cf37f321dc14 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:51.224926 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f715d66f-bc20-4006-9849-cf37f321dc14 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:51.225362 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f715d66f-bc20-4006-9849-cf37f321dc14 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:51.226061 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f715d66f-bc20-4006-9849-cf37f321dc14 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:51.226674 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f715d66f-bc20-4006-9849-cf37f321dc14 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:51.227645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f715d66f-bc20-4006-9849-cf37f321dc14 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:51.289128 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.objects.instance [None req-f715d66f-bc20-4006-9849-cf37f321dc14 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lazy-loading 'flavor' on Instance uuid 8c46dee0-bdd3-468a-ad6d-52a9f50e8210 {{(pid=131394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:44:51.312124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-4c19f321-ff1e-4bf1-a600-663024b74e8d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:51.320757 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-4c19f321-ff1e-4bf1-a600-663024b74e8d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:51.322267 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-4c19f321-ff1e-4bf1-a600-663024b74e8d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:51.323501 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-4c19f321-ff1e-4bf1-a600-663024b74e8d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.157887 Aug 17 23:44:51.324257 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 145/293] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:51 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:44:51.420857 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f715d66f-bc20-4006-9849-cf37f321dc14 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "POST /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210/action" status: 200 len: 32 microversion: 2.1 time: 0.209769 Aug 17 23:44:51.428840 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 149/294] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 17 23:44:51 2022] POST /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210/action => generated 32 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 17 23:44:51.434175 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-22eee034-015a-4282-9abd-7aeae43fccab tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:51.434905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-22eee034-015a-4282-9abd-7aeae43fccab tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:51.449681 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22eee034-015a-4282-9abd-7aeae43fccab tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:51.450275 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22eee034-015a-4282-9abd-7aeae43fccab tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:51.450770 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22eee034-015a-4282-9abd-7aeae43fccab tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:51.451562 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22eee034-015a-4282-9abd-7aeae43fccab tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:51.452108 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22eee034-015a-4282-9abd-7aeae43fccab tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:51.452535 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22eee034-015a-4282-9abd-7aeae43fccab tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:51.602132 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-22eee034-015a-4282-9abd-7aeae43fccab tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:51.610020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-22eee034-015a-4282-9abd-7aeae43fccab tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.179838 Aug 17 23:44:51.610677 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 146/295] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:51 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:51.622870 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-aeed1a54-032e-4351-8e43-d940861de0d4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:51.623631 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-aeed1a54-032e-4351-8e43-d940861de0d4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:51.629756 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aeed1a54-032e-4351-8e43-d940861de0d4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:51.630240 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aeed1a54-032e-4351-8e43-d940861de0d4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:51.630683 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aeed1a54-032e-4351-8e43-d940861de0d4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:51.631373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aeed1a54-032e-4351-8e43-d940861de0d4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:51.631833 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aeed1a54-032e-4351-8e43-d940861de0d4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:51.632321 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aeed1a54-032e-4351-8e43-d940861de0d4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:51.766018 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-aeed1a54-032e-4351-8e43-d940861de0d4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:51.774837 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-aeed1a54-032e-4351-8e43-d940861de0d4 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1315 microversion: 2.1 time: 0.156217 Aug 17 23:44:51.775391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 150/296] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:51 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:52.345977 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-50e9360c-0eed-41dd-a909-06d48b767ded tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:52.347130 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-50e9360c-0eed-41dd-a909-06d48b767ded tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:52.359582 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-50e9360c-0eed-41dd-a909-06d48b767ded tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:52.362122 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-50e9360c-0eed-41dd-a909-06d48b767ded tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:52.362577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-50e9360c-0eed-41dd-a909-06d48b767ded tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:52.363302 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-50e9360c-0eed-41dd-a909-06d48b767ded tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:52.363891 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-50e9360c-0eed-41dd-a909-06d48b767ded tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:52.364366 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-50e9360c-0eed-41dd-a909-06d48b767ded tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:52.642789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-50e9360c-0eed-41dd-a909-06d48b767ded tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:52.644743 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-fa15449c-1e27-4381-959a-f5a7e994e09f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:52.646029 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-fa15449c-1e27-4381-959a-f5a7e994e09f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:52.651347 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-50e9360c-0eed-41dd-a909-06d48b767ded tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:52.653835 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa15449c-1e27-4381-959a-f5a7e994e09f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:52.654602 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa15449c-1e27-4381-959a-f5a7e994e09f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:52.655088 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa15449c-1e27-4381-959a-f5a7e994e09f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:52.656870 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-50e9360c-0eed-41dd-a909-06d48b767ded tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:52.657830 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa15449c-1e27-4381-959a-f5a7e994e09f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:52.658008 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-50e9360c-0eed-41dd-a909-06d48b767ded tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.315854 Aug 17 23:44:52.658307 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa15449c-1e27-4381-959a-f5a7e994e09f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:52.662795 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 147/297] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:52 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:52.667707 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa15449c-1e27-4381-959a-f5a7e994e09f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:52.797925 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-be6de202-2f42-421a-96d9-815e4ae29508 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:52.798539 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-be6de202-2f42-421a-96d9-815e4ae29508 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:52.812499 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-be6de202-2f42-421a-96d9-815e4ae29508 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:52.812983 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-be6de202-2f42-421a-96d9-815e4ae29508 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:52.813420 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-be6de202-2f42-421a-96d9-815e4ae29508 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:52.814124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-be6de202-2f42-421a-96d9-815e4ae29508 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:52.814582 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-be6de202-2f42-421a-96d9-815e4ae29508 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:52.815005 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-be6de202-2f42-421a-96d9-815e4ae29508 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:52.862723 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-fa15449c-1e27-4381-959a-f5a7e994e09f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:52.866381 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:44:52.872233 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-fa15449c-1e27-4381-959a-f5a7e994e09f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.231909 Aug 17 23:44:52.872971 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 151/298] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:52 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:53.111613 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-be6de202-2f42-421a-96d9-815e4ae29508 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:53.120841 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-be6de202-2f42-421a-96d9-815e4ae29508 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1502 microversion: 2.1 time: 0.326584 Aug 17 23:44:53.121987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 148/299] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:52 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1502 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:53.693340 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f022cc0e-36dd-4ba5-9266-641e53fdf19d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:53.693989 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f022cc0e-36dd-4ba5-9266-641e53fdf19d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:53.701402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f022cc0e-36dd-4ba5-9266-641e53fdf19d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:53.701994 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f022cc0e-36dd-4ba5-9266-641e53fdf19d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:53.702323 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f022cc0e-36dd-4ba5-9266-641e53fdf19d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:53.703026 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f022cc0e-36dd-4ba5-9266-641e53fdf19d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:53.703475 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f022cc0e-36dd-4ba5-9266-641e53fdf19d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:53.703904 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f022cc0e-36dd-4ba5-9266-641e53fdf19d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:53.893800 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-d102f003-b471-46f9-89fe-2c9ba0e249fb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:53.895269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-d102f003-b471-46f9-89fe-2c9ba0e249fb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:53.898301 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f022cc0e-36dd-4ba5-9266-641e53fdf19d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:53.902502 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d102f003-b471-46f9-89fe-2c9ba0e249fb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:53.903446 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d102f003-b471-46f9-89fe-2c9ba0e249fb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:53.904294 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d102f003-b471-46f9-89fe-2c9ba0e249fb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:53.905303 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d102f003-b471-46f9-89fe-2c9ba0e249fb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:53.905856 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d102f003-b471-46f9-89fe-2c9ba0e249fb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:53.906668 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d102f003-b471-46f9-89fe-2c9ba0e249fb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:53.912334 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f022cc0e-36dd-4ba5-9266-641e53fdf19d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:53.914761 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f022cc0e-36dd-4ba5-9266-641e53fdf19d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:53.921109 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f022cc0e-36dd-4ba5-9266-641e53fdf19d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.227516 Aug 17 23:44:53.922089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 152/300] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:53 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:54.086408 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d102f003-b471-46f9-89fe-2c9ba0e249fb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:54.097668 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-d102f003-b471-46f9-89fe-2c9ba0e249fb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.205439 Aug 17 23:44:54.115232 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 149/301] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:53 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:54.945016 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-39aa7a20-9836-4709-a7b6-c27f15631d36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:54.945558 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-39aa7a20-9836-4709-a7b6-c27f15631d36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:54.952285 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-39aa7a20-9836-4709-a7b6-c27f15631d36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:54.953002 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-39aa7a20-9836-4709-a7b6-c27f15631d36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:54.953620 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-39aa7a20-9836-4709-a7b6-c27f15631d36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:54.954459 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-39aa7a20-9836-4709-a7b6-c27f15631d36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:54.955118 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-39aa7a20-9836-4709-a7b6-c27f15631d36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:54.955748 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-39aa7a20-9836-4709-a7b6-c27f15631d36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:55.126325 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f9d2359c-1f76-4e70-bf91-2bcd3e6c7a98 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:55.128341 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f9d2359c-1f76-4e70-bf91-2bcd3e6c7a98 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:55.134231 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-39aa7a20-9836-4709-a7b6-c27f15631d36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:55.143681 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f9d2359c-1f76-4e70-bf91-2bcd3e6c7a98 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:55.144597 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-39aa7a20-9836-4709-a7b6-c27f15631d36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:55.146256 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-39aa7a20-9836-4709-a7b6-c27f15631d36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:55.147461 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-39aa7a20-9836-4709-a7b6-c27f15631d36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.206285 Aug 17 23:44:55.148429 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 153/302] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:54 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:55.156125 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f9d2359c-1f76-4e70-bf91-2bcd3e6c7a98 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:55.158611 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f9d2359c-1f76-4e70-bf91-2bcd3e6c7a98 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:55.159438 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f9d2359c-1f76-4e70-bf91-2bcd3e6c7a98 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:55.159851 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f9d2359c-1f76-4e70-bf91-2bcd3e6c7a98 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:55.162852 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f9d2359c-1f76-4e70-bf91-2bcd3e6c7a98 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:55.576195 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f9d2359c-1f76-4e70-bf91-2bcd3e6c7a98 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:55.588489 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f9d2359c-1f76-4e70-bf91-2bcd3e6c7a98 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.467552 Aug 17 23:44:55.589421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 150/303] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:55 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:55.635387 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-41f1869e-6b8c-44d1-aa9e-03493d96d854 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "118780aa-abd1-4915-9ede-0c305257a21e"}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:44:55.638757 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-41f1869e-6b8c-44d1-aa9e-03493d96d854 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:55.645757 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-41f1869e-6b8c-44d1-aa9e-03493d96d854 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:55.646656 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-41f1869e-6b8c-44d1-aa9e-03493d96d854 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:55.647271 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-41f1869e-6b8c-44d1-aa9e-03493d96d854 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:55.647991 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-41f1869e-6b8c-44d1-aa9e-03493d96d854 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:55.648667 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-41f1869e-6b8c-44d1-aa9e-03493d96d854 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:55.649560 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-41f1869e-6b8c-44d1-aa9e-03493d96d854 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:56.171706 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-79c7e2ec-9b1a-46a2-857d-0c761977832e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:56.172606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-79c7e2ec-9b1a-46a2-857d-0c761977832e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:56.187714 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-79c7e2ec-9b1a-46a2-857d-0c761977832e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:56.188482 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-79c7e2ec-9b1a-46a2-857d-0c761977832e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:56.189398 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-79c7e2ec-9b1a-46a2-857d-0c761977832e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:56.190458 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-79c7e2ec-9b1a-46a2-857d-0c761977832e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:56.191287 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-79c7e2ec-9b1a-46a2-857d-0c761977832e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:56.192352 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-79c7e2ec-9b1a-46a2-857d-0c761977832e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:56.263077 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-41f1869e-6b8c-44d1-aa9e-03493d96d854 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "POST /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.631715 Aug 17 23:44:56.265057 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 154/304] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 17 23:44:55 2022] POST /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86/os-volume_attachments => generated 194 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:44:56.385084 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-79c7e2ec-9b1a-46a2-857d-0c761977832e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:56.405909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-79c7e2ec-9b1a-46a2-857d-0c761977832e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:56.405909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-79c7e2ec-9b1a-46a2-857d-0c761977832e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:56.405909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-79c7e2ec-9b1a-46a2-857d-0c761977832e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.231038 Aug 17 23:44:56.406203 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 151/305] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:56 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:44:56.615205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-4a42a9c6-cd1b-4968-8121-644154dff9d9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:56.616657 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-4a42a9c6-cd1b-4968-8121-644154dff9d9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:56.624919 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4a42a9c6-cd1b-4968-8121-644154dff9d9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:56.625591 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4a42a9c6-cd1b-4968-8121-644154dff9d9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:56.626216 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4a42a9c6-cd1b-4968-8121-644154dff9d9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:56.627288 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4a42a9c6-cd1b-4968-8121-644154dff9d9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:56.627887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4a42a9c6-cd1b-4968-8121-644154dff9d9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:56.628504 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4a42a9c6-cd1b-4968-8121-644154dff9d9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:56.775336 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-4a42a9c6-cd1b-4968-8121-644154dff9d9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:56.783922 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-4a42a9c6-cd1b-4968-8121-644154dff9d9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.177118 Aug 17 23:44:56.784836 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 155/306] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:56 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:57.423948 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3c42a9c6-1a18-4b6f-8905-055c6247805b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:57.423948 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3c42a9c6-1a18-4b6f-8905-055c6247805b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:57.428190 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3c42a9c6-1a18-4b6f-8905-055c6247805b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:57.428748 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3c42a9c6-1a18-4b6f-8905-055c6247805b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:57.429541 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3c42a9c6-1a18-4b6f-8905-055c6247805b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:57.430435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3c42a9c6-1a18-4b6f-8905-055c6247805b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:57.430957 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3c42a9c6-1a18-4b6f-8905-055c6247805b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:57.431616 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3c42a9c6-1a18-4b6f-8905-055c6247805b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:57.565317 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3c42a9c6-1a18-4b6f-8905-055c6247805b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:57.573182 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3c42a9c6-1a18-4b6f-8905-055c6247805b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:57.575425 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3c42a9c6-1a18-4b6f-8905-055c6247805b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:57.576541 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3c42a9c6-1a18-4b6f-8905-055c6247805b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.159813 Aug 17 23:44:57.577078 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 152/307] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:57 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:57.806453 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-0341f0f0-5926-4fa0-af84-20571da3c9a9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:57.807080 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-0341f0f0-5926-4fa0-af84-20571da3c9a9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:57.814157 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0341f0f0-5926-4fa0-af84-20571da3c9a9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:57.814641 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0341f0f0-5926-4fa0-af84-20571da3c9a9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:57.815083 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0341f0f0-5926-4fa0-af84-20571da3c9a9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:57.815779 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0341f0f0-5926-4fa0-af84-20571da3c9a9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:57.816262 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0341f0f0-5926-4fa0-af84-20571da3c9a9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:57.816688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0341f0f0-5926-4fa0-af84-20571da3c9a9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:57.950500 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0341f0f0-5926-4fa0-af84-20571da3c9a9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:57.957916 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-0341f0f0-5926-4fa0-af84-20571da3c9a9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.155357 Aug 17 23:44:57.958479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 156/308] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:57 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:58.598382 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c1c0d94e-f496-4ae5-afb3-45bc0352fb21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:58.599608 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c1c0d94e-f496-4ae5-afb3-45bc0352fb21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:58.604766 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1c0d94e-f496-4ae5-afb3-45bc0352fb21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:58.605782 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1c0d94e-f496-4ae5-afb3-45bc0352fb21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:58.606205 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1c0d94e-f496-4ae5-afb3-45bc0352fb21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:58.607011 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1c0d94e-f496-4ae5-afb3-45bc0352fb21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:58.607462 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1c0d94e-f496-4ae5-afb3-45bc0352fb21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:58.607881 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1c0d94e-f496-4ae5-afb3-45bc0352fb21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:58.750911 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c1c0d94e-f496-4ae5-afb3-45bc0352fb21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:58.759218 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c1c0d94e-f496-4ae5-afb3-45bc0352fb21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:58.760863 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c1c0d94e-f496-4ae5-afb3-45bc0352fb21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:58.764829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c1c0d94e-f496-4ae5-afb3-45bc0352fb21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.167438 Aug 17 23:44:58.764829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 153/309] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:58 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:44:58.978699 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-fb13339c-8102-4dac-8484-a7f5785a7341 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:58.979730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-fb13339c-8102-4dac-8484-a7f5785a7341 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:58.987654 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fb13339c-8102-4dac-8484-a7f5785a7341 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:58.988185 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fb13339c-8102-4dac-8484-a7f5785a7341 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:58.988668 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fb13339c-8102-4dac-8484-a7f5785a7341 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:58.989402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fb13339c-8102-4dac-8484-a7f5785a7341 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:58.989861 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fb13339c-8102-4dac-8484-a7f5785a7341 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:58.990278 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fb13339c-8102-4dac-8484-a7f5785a7341 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:59.145880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-fb13339c-8102-4dac-8484-a7f5785a7341 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:59.154104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-fb13339c-8102-4dac-8484-a7f5785a7341 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.179348 Aug 17 23:44:59.154667 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 157/310] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:44:58 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:44:59.784580 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c0e54afc-c964-4cac-850d-9689c44b28e7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:44:59.785455 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c0e54afc-c964-4cac-850d-9689c44b28e7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:44:59.791750 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0e54afc-c964-4cac-850d-9689c44b28e7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:59.792260 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0e54afc-c964-4cac-850d-9689c44b28e7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:59.792697 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0e54afc-c964-4cac-850d-9689c44b28e7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:59.793375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0e54afc-c964-4cac-850d-9689c44b28e7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:44:59.793827 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0e54afc-c964-4cac-850d-9689c44b28e7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:44:59.794251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0e54afc-c964-4cac-850d-9689c44b28e7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:44:59.920481 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c0e54afc-c964-4cac-850d-9689c44b28e7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:59.928295 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c0e54afc-c964-4cac-850d-9689c44b28e7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:59.929801 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c0e54afc-c964-4cac-850d-9689c44b28e7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:44:59.930889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c0e54afc-c964-4cac-850d-9689c44b28e7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.150202 Aug 17 23:44:59.931435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 154/311] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:44:59 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:45:00.175269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c5fd01ab-3660-495e-87cc-e8d29a966c2d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:00.175821 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c5fd01ab-3660-495e-87cc-e8d29a966c2d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:00.184110 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5fd01ab-3660-495e-87cc-e8d29a966c2d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:00.184815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5fd01ab-3660-495e-87cc-e8d29a966c2d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:00.185272 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5fd01ab-3660-495e-87cc-e8d29a966c2d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:00.185956 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5fd01ab-3660-495e-87cc-e8d29a966c2d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:00.186415 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5fd01ab-3660-495e-87cc-e8d29a966c2d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:00.186911 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5fd01ab-3660-495e-87cc-e8d29a966c2d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:00.328054 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c5fd01ab-3660-495e-87cc-e8d29a966c2d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:00.335445 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c5fd01ab-3660-495e-87cc-e8d29a966c2d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.164245 Aug 17 23:45:00.336029 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 158/312] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:00 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:00.959027 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3af76f27-6c48-4290-93a1-24f3f65e149b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:00.960250 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3af76f27-6c48-4290-93a1-24f3f65e149b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:00.970690 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3af76f27-6c48-4290-93a1-24f3f65e149b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:00.971674 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3af76f27-6c48-4290-93a1-24f3f65e149b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:00.972244 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3af76f27-6c48-4290-93a1-24f3f65e149b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:00.973171 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3af76f27-6c48-4290-93a1-24f3f65e149b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:00.973722 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3af76f27-6c48-4290-93a1-24f3f65e149b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:00.974878 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3af76f27-6c48-4290-93a1-24f3f65e149b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:01.141143 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3af76f27-6c48-4290-93a1-24f3f65e149b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:01.148947 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3af76f27-6c48-4290-93a1-24f3f65e149b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:01.150480 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3af76f27-6c48-4290-93a1-24f3f65e149b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:01.151579 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3af76f27-6c48-4290-93a1-24f3f65e149b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.198917 Aug 17 23:45:01.153239 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 155/313] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:45:00 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:45:01.355524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-de086002-b289-4432-81b5-5d7005b890ed tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:01.356105 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-de086002-b289-4432-81b5-5d7005b890ed tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:01.362472 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de086002-b289-4432-81b5-5d7005b890ed tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:01.362955 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de086002-b289-4432-81b5-5d7005b890ed tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:01.363392 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de086002-b289-4432-81b5-5d7005b890ed tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:01.364105 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de086002-b289-4432-81b5-5d7005b890ed tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:01.364893 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de086002-b289-4432-81b5-5d7005b890ed tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:01.365030 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de086002-b289-4432-81b5-5d7005b890ed tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:01.510078 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-de086002-b289-4432-81b5-5d7005b890ed tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:01.518358 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-de086002-b289-4432-81b5-5d7005b890ed tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.166766 Aug 17 23:45:01.518917 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 159/314] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:01 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:02.175273 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b9761815-3dbf-4d36-adb0-58fe09820bc0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:02.175830 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b9761815-3dbf-4d36-adb0-58fe09820bc0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:02.181747 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b9761815-3dbf-4d36-adb0-58fe09820bc0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:02.182229 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b9761815-3dbf-4d36-adb0-58fe09820bc0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:02.182666 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b9761815-3dbf-4d36-adb0-58fe09820bc0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:02.183347 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b9761815-3dbf-4d36-adb0-58fe09820bc0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:02.183800 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b9761815-3dbf-4d36-adb0-58fe09820bc0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:02.184247 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b9761815-3dbf-4d36-adb0-58fe09820bc0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:02.329816 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b9761815-3dbf-4d36-adb0-58fe09820bc0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:02.338193 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b9761815-3dbf-4d36-adb0-58fe09820bc0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:02.340465 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b9761815-3dbf-4d36-adb0-58fe09820bc0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:02.341700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b9761815-3dbf-4d36-adb0-58fe09820bc0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.170443 Aug 17 23:45:02.342333 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 156/315] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:45:02 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:45:02.427736 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-0b9f5e44-9887-4680-9d1d-5685fa729c84 req-9f85720c-5595-426e-8ba6-6000e3b7e4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abc34597-7782-4715-86c3-6a940ecde323", "name": "network-vif-plugged", "status": "completed", "tag": "bce8dab3-ded2-46e7-a72a-7a52eb3c9201"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:45:02.438162 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-0b9f5e44-9887-4680-9d1d-5685fa729c84 req-9f85720c-5595-426e-8ba6-6000e3b7e4e3 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:02.438872 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-0b9f5e44-9887-4680-9d1d-5685fa729c84 req-9f85720c-5595-426e-8ba6-6000e3b7e4e3 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:02.439951 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-0b9f5e44-9887-4680-9d1d-5685fa729c84 req-9f85720c-5595-426e-8ba6-6000e3b7e4e3 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:02.453058 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-0b9f5e44-9887-4680-9d1d-5685fa729c84 req-9f85720c-5595-426e-8ba6-6000e3b7e4e3 service nova] Creating event network-vif-plugged:bce8dab3-ded2-46e7-a72a-7a52eb3c9201 for instance abc34597-7782-4715-86c3-6a940ecde323 on hv-cinder-82002 Aug 17 23:45:02.458729 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-0b9f5e44-9887-4680-9d1d-5685fa729c84 req-9f85720c-5595-426e-8ba6-6000e3b7e4e3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035426 Aug 17 23:45:02.459618 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 160/316] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:45:02.538929 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-464bf9ca-779e-4125-9ebc-d7ad3fefbd32 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:02.539550 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-464bf9ca-779e-4125-9ebc-d7ad3fefbd32 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:02.545503 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-464bf9ca-779e-4125-9ebc-d7ad3fefbd32 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:02.545991 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-464bf9ca-779e-4125-9ebc-d7ad3fefbd32 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:02.546430 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-464bf9ca-779e-4125-9ebc-d7ad3fefbd32 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:02.547119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-464bf9ca-779e-4125-9ebc-d7ad3fefbd32 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:02.547580 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-464bf9ca-779e-4125-9ebc-d7ad3fefbd32 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:02.548030 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-464bf9ca-779e-4125-9ebc-d7ad3fefbd32 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:02.724777 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-464bf9ca-779e-4125-9ebc-d7ad3fefbd32 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:02.733879 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-464bf9ca-779e-4125-9ebc-d7ad3fefbd32 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.199027 Aug 17 23:45:02.734726 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 157/317] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:02 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:03.364607 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-dbda415f-a462-4200-82df-e77dc75915db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:03.365293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-dbda415f-a462-4200-82df-e77dc75915db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:03.371217 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dbda415f-a462-4200-82df-e77dc75915db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:03.371693 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dbda415f-a462-4200-82df-e77dc75915db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:03.372161 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dbda415f-a462-4200-82df-e77dc75915db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:03.372839 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dbda415f-a462-4200-82df-e77dc75915db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:03.373287 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dbda415f-a462-4200-82df-e77dc75915db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:03.373730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dbda415f-a462-4200-82df-e77dc75915db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:03.512621 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dbda415f-a462-4200-82df-e77dc75915db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:03.524582 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dbda415f-a462-4200-82df-e77dc75915db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:03.526091 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dbda415f-a462-4200-82df-e77dc75915db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:03.527230 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-dbda415f-a462-4200-82df-e77dc75915db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.166975 Aug 17 23:45:03.527775 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 161/318] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:45:03 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:45:03.755787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a6f18c67-5e87-4b18-a93f-6b71b4cbfd48 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:03.756586 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a6f18c67-5e87-4b18-a93f-6b71b4cbfd48 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:03.763492 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a6f18c67-5e87-4b18-a93f-6b71b4cbfd48 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:03.764105 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a6f18c67-5e87-4b18-a93f-6b71b4cbfd48 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:03.764550 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a6f18c67-5e87-4b18-a93f-6b71b4cbfd48 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:03.765251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a6f18c67-5e87-4b18-a93f-6b71b4cbfd48 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:03.765713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a6f18c67-5e87-4b18-a93f-6b71b4cbfd48 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:03.766139 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a6f18c67-5e87-4b18-a93f-6b71b4cbfd48 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:03.897336 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a6f18c67-5e87-4b18-a93f-6b71b4cbfd48 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:03.905082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a6f18c67-5e87-4b18-a93f-6b71b4cbfd48 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.153461 Aug 17 23:45:03.905645 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 158/319] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:03 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:04.549897 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f7ec6550-9332-4a44-ba0f-84f2ac224923 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:04.550472 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f7ec6550-9332-4a44-ba0f-84f2ac224923 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:04.556828 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f7ec6550-9332-4a44-ba0f-84f2ac224923 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:04.557313 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f7ec6550-9332-4a44-ba0f-84f2ac224923 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:04.557757 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f7ec6550-9332-4a44-ba0f-84f2ac224923 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:04.558442 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f7ec6550-9332-4a44-ba0f-84f2ac224923 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:04.558901 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f7ec6550-9332-4a44-ba0f-84f2ac224923 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:04.559325 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f7ec6550-9332-4a44-ba0f-84f2ac224923 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:04.697458 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f7ec6550-9332-4a44-ba0f-84f2ac224923 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:04.705790 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f7ec6550-9332-4a44-ba0f-84f2ac224923 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:04.707288 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f7ec6550-9332-4a44-ba0f-84f2ac224923 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:04.708409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f7ec6550-9332-4a44-ba0f-84f2ac224923 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.162499 Aug 17 23:45:04.708952 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 162/320] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:45:04 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:45:04.926319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-17c867c1-428c-433e-af89-a3dfe45d7e4d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:04.926928 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-17c867c1-428c-433e-af89-a3dfe45d7e4d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:04.932838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-17c867c1-428c-433e-af89-a3dfe45d7e4d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:04.933813 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-17c867c1-428c-433e-af89-a3dfe45d7e4d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:04.934242 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-17c867c1-428c-433e-af89-a3dfe45d7e4d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:04.934912 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-17c867c1-428c-433e-af89-a3dfe45d7e4d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:04.935361 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-17c867c1-428c-433e-af89-a3dfe45d7e4d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:04.935775 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-17c867c1-428c-433e-af89-a3dfe45d7e4d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:04.953703 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=100 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:45:05.067179 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-17c867c1-428c-433e-af89-a3dfe45d7e4d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:05.075351 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-17c867c1-428c-433e-af89-a3dfe45d7e4d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.152811 Aug 17 23:45:05.075919 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 159/321] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:04 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:05.731347 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-413d5574-76d9-417d-b637-c276262528e9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:05.732097 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-413d5574-76d9-417d-b637-c276262528e9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:05.738422 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-413d5574-76d9-417d-b637-c276262528e9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:05.738978 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-413d5574-76d9-417d-b637-c276262528e9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:05.739419 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-413d5574-76d9-417d-b637-c276262528e9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:05.740142 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-413d5574-76d9-417d-b637-c276262528e9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:05.740602 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-413d5574-76d9-417d-b637-c276262528e9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:05.741032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-413d5574-76d9-417d-b637-c276262528e9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:05.873817 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-413d5574-76d9-417d-b637-c276262528e9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:05.881862 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-413d5574-76d9-417d-b637-c276262528e9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:05.883291 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-413d5574-76d9-417d-b637-c276262528e9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:05.884406 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-413d5574-76d9-417d-b637-c276262528e9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.157493 Aug 17 23:45:05.884951 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 163/322] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:45:05 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:45:06.096511 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1f4c452b-6362-4eb0-a686-cc429ff25e3b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:06.097124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-1f4c452b-6362-4eb0-a686-cc429ff25e3b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:06.103237 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1f4c452b-6362-4eb0-a686-cc429ff25e3b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:06.103745 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1f4c452b-6362-4eb0-a686-cc429ff25e3b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:06.104334 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1f4c452b-6362-4eb0-a686-cc429ff25e3b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:06.105039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1f4c452b-6362-4eb0-a686-cc429ff25e3b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:06.105506 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1f4c452b-6362-4eb0-a686-cc429ff25e3b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:06.105982 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1f4c452b-6362-4eb0-a686-cc429ff25e3b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:06.237386 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1f4c452b-6362-4eb0-a686-cc429ff25e3b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:06.245158 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-1f4c452b-6362-4eb0-a686-cc429ff25e3b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.152512 Aug 17 23:45:06.245770 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 160/323] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:06 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:06.907277 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-23055edb-43f2-426e-a1b3-7a1d28399f95 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:06.907884 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-23055edb-43f2-426e-a1b3-7a1d28399f95 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:06.916050 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-23055edb-43f2-426e-a1b3-7a1d28399f95 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:06.916538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-23055edb-43f2-426e-a1b3-7a1d28399f95 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:06.916971 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-23055edb-43f2-426e-a1b3-7a1d28399f95 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:06.917662 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-23055edb-43f2-426e-a1b3-7a1d28399f95 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:06.918117 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-23055edb-43f2-426e-a1b3-7a1d28399f95 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:06.918540 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-23055edb-43f2-426e-a1b3-7a1d28399f95 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:07.051448 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-23055edb-43f2-426e-a1b3-7a1d28399f95 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:07.059158 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-23055edb-43f2-426e-a1b3-7a1d28399f95 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:07.060669 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-23055edb-43f2-426e-a1b3-7a1d28399f95 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:07.061749 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-23055edb-43f2-426e-a1b3-7a1d28399f95 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.158310 Aug 17 23:45:07.062324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 164/324] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:45:06 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:45:07.266452 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-67212c1f-e2cd-40a9-8f04-6d68c2ffb102 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:07.266981 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-67212c1f-e2cd-40a9-8f04-6d68c2ffb102 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:07.272880 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-67212c1f-e2cd-40a9-8f04-6d68c2ffb102 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:07.273362 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-67212c1f-e2cd-40a9-8f04-6d68c2ffb102 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:07.273796 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-67212c1f-e2cd-40a9-8f04-6d68c2ffb102 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:07.274475 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-67212c1f-e2cd-40a9-8f04-6d68c2ffb102 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:07.274931 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-67212c1f-e2cd-40a9-8f04-6d68c2ffb102 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:07.275354 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-67212c1f-e2cd-40a9-8f04-6d68c2ffb102 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:07.402677 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-67212c1f-e2cd-40a9-8f04-6d68c2ffb102 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:07.410908 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-67212c1f-e2cd-40a9-8f04-6d68c2ffb102 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.147994 Aug 17 23:45:07.411484 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 161/325] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:07 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:08.083366 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9091cdb3-da75-493b-add1-f32ef6661cb6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:08.083985 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9091cdb3-da75-493b-add1-f32ef6661cb6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:08.090862 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9091cdb3-da75-493b-add1-f32ef6661cb6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:08.091343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9091cdb3-da75-493b-add1-f32ef6661cb6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:08.091781 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9091cdb3-da75-493b-add1-f32ef6661cb6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:08.092493 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9091cdb3-da75-493b-add1-f32ef6661cb6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:08.092948 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9091cdb3-da75-493b-add1-f32ef6661cb6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:08.093372 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9091cdb3-da75-493b-add1-f32ef6661cb6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:08.224341 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9091cdb3-da75-493b-add1-f32ef6661cb6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:08.233101 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9091cdb3-da75-493b-add1-f32ef6661cb6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:08.234594 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9091cdb3-da75-493b-add1-f32ef6661cb6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:08.235678 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9091cdb3-da75-493b-add1-f32ef6661cb6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.156144 Aug 17 23:45:08.236252 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 165/326] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:45:08 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:45:08.431537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-abca00d5-ff54-47fc-b32a-043885d53734 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:08.432117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-abca00d5-ff54-47fc-b32a-043885d53734 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:08.438010 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-abca00d5-ff54-47fc-b32a-043885d53734 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:08.438494 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-abca00d5-ff54-47fc-b32a-043885d53734 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:08.438928 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-abca00d5-ff54-47fc-b32a-043885d53734 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:08.439616 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-abca00d5-ff54-47fc-b32a-043885d53734 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:08.440104 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-abca00d5-ff54-47fc-b32a-043885d53734 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:08.440529 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-abca00d5-ff54-47fc-b32a-043885d53734 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:08.571521 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-abca00d5-ff54-47fc-b32a-043885d53734 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:08.579873 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-abca00d5-ff54-47fc-b32a-043885d53734 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.152246 Aug 17 23:45:08.580466 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 162/327] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:08 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:09.257908 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-70d9d5cd-ccad-4fe4-a7f2-488076ff1acd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:09.258542 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-70d9d5cd-ccad-4fe4-a7f2-488076ff1acd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:09.265005 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-70d9d5cd-ccad-4fe4-a7f2-488076ff1acd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:09.265503 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-70d9d5cd-ccad-4fe4-a7f2-488076ff1acd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:09.266064 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-70d9d5cd-ccad-4fe4-a7f2-488076ff1acd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:09.266876 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-70d9d5cd-ccad-4fe4-a7f2-488076ff1acd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:09.267077 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-70d9d5cd-ccad-4fe4-a7f2-488076ff1acd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:09.267508 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-70d9d5cd-ccad-4fe4-a7f2-488076ff1acd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:09.395484 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-70d9d5cd-ccad-4fe4-a7f2-488076ff1acd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:09.403913 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-70d9d5cd-ccad-4fe4-a7f2-488076ff1acd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:09.405524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-70d9d5cd-ccad-4fe4-a7f2-488076ff1acd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:09.406684 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-70d9d5cd-ccad-4fe4-a7f2-488076ff1acd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.152710 Aug 17 23:45:09.407380 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 166/328] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:45:09 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:45:09.600997 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b02283c5-7e89-48b0-bdfe-383241369615 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:09.601608 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b02283c5-7e89-48b0-bdfe-383241369615 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:09.608226 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b02283c5-7e89-48b0-bdfe-383241369615 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:09.608721 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b02283c5-7e89-48b0-bdfe-383241369615 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:09.609156 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b02283c5-7e89-48b0-bdfe-383241369615 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:09.609844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b02283c5-7e89-48b0-bdfe-383241369615 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:09.610298 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b02283c5-7e89-48b0-bdfe-383241369615 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:09.610724 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b02283c5-7e89-48b0-bdfe-383241369615 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:09.739732 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b02283c5-7e89-48b0-bdfe-383241369615 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:09.747112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b02283c5-7e89-48b0-bdfe-383241369615 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.149944 Aug 17 23:45:09.747667 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 163/329] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:09 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:10.430418 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-88762010-c7d1-49bc-94d5-cdfdb847d545 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:10.430925 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-88762010-c7d1-49bc-94d5-cdfdb847d545 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:10.438145 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-88762010-c7d1-49bc-94d5-cdfdb847d545 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:10.438610 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-88762010-c7d1-49bc-94d5-cdfdb847d545 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:10.439044 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-88762010-c7d1-49bc-94d5-cdfdb847d545 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:10.439730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-88762010-c7d1-49bc-94d5-cdfdb847d545 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:10.440201 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-88762010-c7d1-49bc-94d5-cdfdb847d545 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:10.440623 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-88762010-c7d1-49bc-94d5-cdfdb847d545 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:10.571776 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-88762010-c7d1-49bc-94d5-cdfdb847d545 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:10.575812 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:45:10.580834 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-88762010-c7d1-49bc-94d5-cdfdb847d545 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:10.582327 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-88762010-c7d1-49bc-94d5-cdfdb847d545 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:10.583420 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-88762010-c7d1-49bc-94d5-cdfdb847d545 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1407 microversion: 2.20 time: 0.156932 Aug 17 23:45:10.584052 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 167/330] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:45:10 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:45:10.768694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b991fecd-1208-491c-a30d-9357c7b0c3c0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:10.769366 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b991fecd-1208-491c-a30d-9357c7b0c3c0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:10.771342 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=72 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:45:10.776588 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b991fecd-1208-491c-a30d-9357c7b0c3c0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:10.777097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b991fecd-1208-491c-a30d-9357c7b0c3c0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:10.778188 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b991fecd-1208-491c-a30d-9357c7b0c3c0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:10.778867 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b991fecd-1208-491c-a30d-9357c7b0c3c0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:10.779318 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b991fecd-1208-491c-a30d-9357c7b0c3c0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:10.779734 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b991fecd-1208-491c-a30d-9357c7b0c3c0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:10.911687 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b991fecd-1208-491c-a30d-9357c7b0c3c0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:10.919220 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b991fecd-1208-491c-a30d-9357c7b0c3c0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.154667 Aug 17 23:45:10.919822 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 164/331] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:10 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:11.607705 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-26d846a5-7ab0-4852-8be2-19a367749294 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:11.608596 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-26d846a5-7ab0-4852-8be2-19a367749294 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:11.618775 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26d846a5-7ab0-4852-8be2-19a367749294 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:11.619268 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26d846a5-7ab0-4852-8be2-19a367749294 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:11.619706 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26d846a5-7ab0-4852-8be2-19a367749294 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:11.620441 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26d846a5-7ab0-4852-8be2-19a367749294 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:11.621990 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26d846a5-7ab0-4852-8be2-19a367749294 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:11.621990 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26d846a5-7ab0-4852-8be2-19a367749294 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:11.783249 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-26d846a5-7ab0-4852-8be2-19a367749294 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:11.792272 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-26d846a5-7ab0-4852-8be2-19a367749294 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:11.799521 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-26d846a5-7ab0-4852-8be2-19a367749294 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:11.800756 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-26d846a5-7ab0-4852-8be2-19a367749294 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1598 microversion: 2.20 time: 0.198198 Aug 17 23:45:11.801306 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 168/332] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:45:11 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1598 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:45:11.823138 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ab6ab48f-9f12-4fc8-a141-28119f6754e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:11.823811 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ab6ab48f-9f12-4fc8-a141-28119f6754e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:11.830005 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ab6ab48f-9f12-4fc8-a141-28119f6754e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:11.830570 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ab6ab48f-9f12-4fc8-a141-28119f6754e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:11.831014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ab6ab48f-9f12-4fc8-a141-28119f6754e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:11.831973 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ab6ab48f-9f12-4fc8-a141-28119f6754e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:11.832443 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ab6ab48f-9f12-4fc8-a141-28119f6754e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:11.833287 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ab6ab48f-9f12-4fc8-a141-28119f6754e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:11.911944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ab6ab48f-9f12-4fc8-a141-28119f6754e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092785 Aug 17 23:45:11.912565 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 165/333] 10.222.0.26 () {60 vars in 1316 bytes} [Wed Aug 17 23:45:11 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 23:45:11.942249 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-65041831-6130-4e36-8a70-5a73c2cde9dc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:11.943765 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-65041831-6130-4e36-8a70-5a73c2cde9dc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:11.950770 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-65041831-6130-4e36-8a70-5a73c2cde9dc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:11.951536 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-65041831-6130-4e36-8a70-5a73c2cde9dc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:11.952292 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-65041831-6130-4e36-8a70-5a73c2cde9dc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:11.953275 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-65041831-6130-4e36-8a70-5a73c2cde9dc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:11.953941 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-65041831-6130-4e36-8a70-5a73c2cde9dc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:11.954578 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-65041831-6130-4e36-8a70-5a73c2cde9dc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:12.101219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-65041831-6130-4e36-8a70-5a73c2cde9dc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:12.108893 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-65041831-6130-4e36-8a70-5a73c2cde9dc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.171554 Aug 17 23:45:12.109466 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 169/334] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:11 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:13.101725 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-03b6b808-36f3-4aea-930b-3157cd60a16d req-40fa27e7-44a2-4cec-b574-8763838506ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abc34597-7782-4715-86c3-6a940ecde323", "tag": "bce8dab3-ded2-46e7-a72a-7a52eb3c9201"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:45:13.113116 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-03b6b808-36f3-4aea-930b-3157cd60a16d req-40fa27e7-44a2-4cec-b574-8763838506ee service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:13.113669 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-03b6b808-36f3-4aea-930b-3157cd60a16d req-40fa27e7-44a2-4cec-b574-8763838506ee service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:13.114175 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-03b6b808-36f3-4aea-930b-3157cd60a16d req-40fa27e7-44a2-4cec-b574-8763838506ee service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:13.131068 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-03b6b808-36f3-4aea-930b-3157cd60a16d req-40fa27e7-44a2-4cec-b574-8763838506ee service nova] Creating event network-changed:bce8dab3-ded2-46e7-a72a-7a52eb3c9201 for instance abc34597-7782-4715-86c3-6a940ecde323 on hv-cinder-82002 Aug 17 23:45:13.133946 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8579ca06-d310-4c2a-bd74-df17efbdd232 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:13.136728 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8579ca06-d310-4c2a-bd74-df17efbdd232 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:13.136875 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-03b6b808-36f3-4aea-930b-3157cd60a16d req-40fa27e7-44a2-4cec-b574-8763838506ee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039012 Aug 17 23:45:13.137644 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 166/335] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:45:13.147390 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8579ca06-d310-4c2a-bd74-df17efbdd232 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:13.147987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8579ca06-d310-4c2a-bd74-df17efbdd232 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:13.148498 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8579ca06-d310-4c2a-bd74-df17efbdd232 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:13.149494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8579ca06-d310-4c2a-bd74-df17efbdd232 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:13.150026 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8579ca06-d310-4c2a-bd74-df17efbdd232 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:13.150677 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8579ca06-d310-4c2a-bd74-df17efbdd232 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:13.512208 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-8579ca06-d310-4c2a-bd74-df17efbdd232 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:13.530878 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8579ca06-d310-4c2a-bd74-df17efbdd232 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.403952 Aug 17 23:45:13.531464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 170/336] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:13 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:14.554538 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2adbf2c3-e0d8-4430-a024-173bfa5c5408 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:14.555420 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2adbf2c3-e0d8-4430-a024-173bfa5c5408 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:14.573931 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2adbf2c3-e0d8-4430-a024-173bfa5c5408 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:14.575625 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2adbf2c3-e0d8-4430-a024-173bfa5c5408 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:14.576381 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2adbf2c3-e0d8-4430-a024-173bfa5c5408 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:14.577263 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2adbf2c3-e0d8-4430-a024-173bfa5c5408 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:14.577876 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2adbf2c3-e0d8-4430-a024-173bfa5c5408 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:14.578460 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2adbf2c3-e0d8-4430-a024-173bfa5c5408 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:14.844959 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2adbf2c3-e0d8-4430-a024-173bfa5c5408 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:14.853445 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2adbf2c3-e0d8-4430-a024-173bfa5c5408 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.303992 Aug 17 23:45:14.854303 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 167/337] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:14 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:15.879085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-149aa0e7-8c95-4011-8c74-f6d37ff39dbc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:15.880012 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-149aa0e7-8c95-4011-8c74-f6d37ff39dbc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:15.894259 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-149aa0e7-8c95-4011-8c74-f6d37ff39dbc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:15.894985 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-149aa0e7-8c95-4011-8c74-f6d37ff39dbc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:15.895514 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-149aa0e7-8c95-4011-8c74-f6d37ff39dbc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:15.896259 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-149aa0e7-8c95-4011-8c74-f6d37ff39dbc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:15.896780 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-149aa0e7-8c95-4011-8c74-f6d37ff39dbc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:15.897178 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-149aa0e7-8c95-4011-8c74-f6d37ff39dbc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:16.065540 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-149aa0e7-8c95-4011-8c74-f6d37ff39dbc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:16.075308 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-149aa0e7-8c95-4011-8c74-f6d37ff39dbc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.200569 Aug 17 23:45:16.075880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 171/338] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:15 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:17.097641 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b4b5fc57-817f-40f0-b11c-338519b25f74 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:17.098348 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b4b5fc57-817f-40f0-b11c-338519b25f74 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:17.105742 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b4b5fc57-817f-40f0-b11c-338519b25f74 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:17.106335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b4b5fc57-817f-40f0-b11c-338519b25f74 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:17.106802 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b4b5fc57-817f-40f0-b11c-338519b25f74 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:17.107493 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b4b5fc57-817f-40f0-b11c-338519b25f74 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:17.107953 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b4b5fc57-817f-40f0-b11c-338519b25f74 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:17.108520 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b4b5fc57-817f-40f0-b11c-338519b25f74 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:17.240853 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b4b5fc57-817f-40f0-b11c-338519b25f74 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:17.248785 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b4b5fc57-817f-40f0-b11c-338519b25f74 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.155716 Aug 17 23:45:17.249343 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 168/339] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:17 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:18.269493 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a64eb484-3ae7-41f3-8b9c-3816c5703272 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:18.270098 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a64eb484-3ae7-41f3-8b9c-3816c5703272 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:18.276597 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a64eb484-3ae7-41f3-8b9c-3816c5703272 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:18.277643 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a64eb484-3ae7-41f3-8b9c-3816c5703272 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:18.278137 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a64eb484-3ae7-41f3-8b9c-3816c5703272 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:18.278862 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a64eb484-3ae7-41f3-8b9c-3816c5703272 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:18.279321 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a64eb484-3ae7-41f3-8b9c-3816c5703272 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:18.279772 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a64eb484-3ae7-41f3-8b9c-3816c5703272 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:18.568415 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a64eb484-3ae7-41f3-8b9c-3816c5703272 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:18.576604 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a64eb484-3ae7-41f3-8b9c-3816c5703272 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.311266 Aug 17 23:45:18.577170 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 172/340] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:18 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:18.782931 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2d97cb9c-2d25-437d-95d9-ec91b4414640 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:18.783427 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2d97cb9c-2d25-437d-95d9-ec91b4414640 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:18.789764 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2d97cb9c-2d25-437d-95d9-ec91b4414640 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:18.790440 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2d97cb9c-2d25-437d-95d9-ec91b4414640 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:18.790900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2d97cb9c-2d25-437d-95d9-ec91b4414640 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:18.791560 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2d97cb9c-2d25-437d-95d9-ec91b4414640 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:18.792045 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2d97cb9c-2d25-437d-95d9-ec91b4414640 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:18.792478 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2d97cb9c-2d25-437d-95d9-ec91b4414640 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:18.817844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2d97cb9c-2d25-437d-95d9-ec91b4414640 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Going to try to terminate instance {{(pid=131395) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:45:18.920470 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2d97cb9c-2d25-437d-95d9-ec91b4414640 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "DELETE /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 204 len: 0 microversion: 2.1 time: 0.143702 Aug 17 23:45:18.924413 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 169/341] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:45:18 2022] DELETE /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 23:45:18.930349 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-991e690d-bb22-4b00-bdf5-0aec58bdc134 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:18.931058 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-991e690d-bb22-4b00-bdf5-0aec58bdc134 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:18.942867 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-991e690d-bb22-4b00-bdf5-0aec58bdc134 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:18.944383 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-991e690d-bb22-4b00-bdf5-0aec58bdc134 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:18.944954 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-991e690d-bb22-4b00-bdf5-0aec58bdc134 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:18.947863 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-991e690d-bb22-4b00-bdf5-0aec58bdc134 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:18.948424 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-991e690d-bb22-4b00-bdf5-0aec58bdc134 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:18.950402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-991e690d-bb22-4b00-bdf5-0aec58bdc134 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:19.097979 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-991e690d-bb22-4b00-bdf5-0aec58bdc134 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:19.110183 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-991e690d-bb22-4b00-bdf5-0aec58bdc134 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1554 microversion: 2.1 time: 0.183647 Aug 17 23:45:19.112320 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 173/342] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:18 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:19.597408 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-01e3c689-6bec-4a2f-b277-ac21e4aa61d0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:19.598094 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-01e3c689-6bec-4a2f-b277-ac21e4aa61d0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:19.603905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-01e3c689-6bec-4a2f-b277-ac21e4aa61d0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:19.604407 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-01e3c689-6bec-4a2f-b277-ac21e4aa61d0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:19.604839 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-01e3c689-6bec-4a2f-b277-ac21e4aa61d0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:19.605551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-01e3c689-6bec-4a2f-b277-ac21e4aa61d0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:19.605995 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-01e3c689-6bec-4a2f-b277-ac21e4aa61d0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:19.606409 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-01e3c689-6bec-4a2f-b277-ac21e4aa61d0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:19.737240 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-01e3c689-6bec-4a2f-b277-ac21e4aa61d0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:19.745751 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-01e3c689-6bec-4a2f-b277-ac21e4aa61d0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.152399 Aug 17 23:45:19.746538 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 170/343] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:19 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:20.132680 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f729c69c-6e09-4410-8f5f-9738a3a61da0 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:20.133293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f729c69c-6e09-4410-8f5f-9738a3a61da0 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:20.135599 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=56 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:45:20.141468 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f729c69c-6e09-4410-8f5f-9738a3a61da0 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:20.141997 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f729c69c-6e09-4410-8f5f-9738a3a61da0 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:20.142434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f729c69c-6e09-4410-8f5f-9738a3a61da0 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:20.143143 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f729c69c-6e09-4410-8f5f-9738a3a61da0 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:20.143602 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f729c69c-6e09-4410-8f5f-9738a3a61da0 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:20.144079 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f729c69c-6e09-4410-8f5f-9738a3a61da0 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:20.283200 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f729c69c-6e09-4410-8f5f-9738a3a61da0 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:20.291452 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f729c69c-6e09-4410-8f5f-9738a3a61da0 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1554 microversion: 2.1 time: 0.162519 Aug 17 23:45:20.292021 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 174/344] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:20 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:20.767036 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-531b35ce-1f1f-4ad0-af46-ba92388625fc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:20.768047 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-531b35ce-1f1f-4ad0-af46-ba92388625fc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:20.781000 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-531b35ce-1f1f-4ad0-af46-ba92388625fc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:20.781000 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-531b35ce-1f1f-4ad0-af46-ba92388625fc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:20.781000 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-531b35ce-1f1f-4ad0-af46-ba92388625fc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:20.781000 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-531b35ce-1f1f-4ad0-af46-ba92388625fc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:20.781358 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-531b35ce-1f1f-4ad0-af46-ba92388625fc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:20.781358 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-531b35ce-1f1f-4ad0-af46-ba92388625fc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:20.929951 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-531b35ce-1f1f-4ad0-af46-ba92388625fc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:20.937818 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-531b35ce-1f1f-4ad0-af46-ba92388625fc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.174790 Aug 17 23:45:20.951715 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 171/345] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:20 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:21.313786 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a3c4ddbd-94b1-428c-a4f0-8adc33f14286 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:21.314405 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a3c4ddbd-94b1-428c-a4f0-8adc33f14286 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:21.321275 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3c4ddbd-94b1-428c-a4f0-8adc33f14286 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:21.321895 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3c4ddbd-94b1-428c-a4f0-8adc33f14286 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:21.322447 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3c4ddbd-94b1-428c-a4f0-8adc33f14286 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:21.323576 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3c4ddbd-94b1-428c-a4f0-8adc33f14286 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:21.326212 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3c4ddbd-94b1-428c-a4f0-8adc33f14286 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:21.326212 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3c4ddbd-94b1-428c-a4f0-8adc33f14286 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:21.479866 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a3c4ddbd-94b1-428c-a4f0-8adc33f14286 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:21.488030 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a3c4ddbd-94b1-428c-a4f0-8adc33f14286 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1554 microversion: 2.1 time: 0.178005 Aug 17 23:45:21.489219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 175/346] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:21 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:21.958473 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-01103914-0535-40c4-8737-ee7ed3f4f793 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:21.959135 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-01103914-0535-40c4-8737-ee7ed3f4f793 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:21.965062 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-01103914-0535-40c4-8737-ee7ed3f4f793 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:21.965540 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-01103914-0535-40c4-8737-ee7ed3f4f793 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:21.965971 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-01103914-0535-40c4-8737-ee7ed3f4f793 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:21.966656 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-01103914-0535-40c4-8737-ee7ed3f4f793 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:21.967130 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-01103914-0535-40c4-8737-ee7ed3f4f793 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:21.967546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-01103914-0535-40c4-8737-ee7ed3f4f793 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:22.100474 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-01103914-0535-40c4-8737-ee7ed3f4f793 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:22.108641 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-01103914-0535-40c4-8737-ee7ed3f4f793 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.153890 Aug 17 23:45:22.109275 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 172/347] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:21 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:22.509902 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-017a6340-b588-44c2-90c2-b5e7e3897c6c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:22.510511 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-017a6340-b588-44c2-90c2-b5e7e3897c6c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:22.517316 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-017a6340-b588-44c2-90c2-b5e7e3897c6c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:22.517800 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-017a6340-b588-44c2-90c2-b5e7e3897c6c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:22.518232 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-017a6340-b588-44c2-90c2-b5e7e3897c6c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:22.518917 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-017a6340-b588-44c2-90c2-b5e7e3897c6c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:22.519542 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-017a6340-b588-44c2-90c2-b5e7e3897c6c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:22.520735 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-017a6340-b588-44c2-90c2-b5e7e3897c6c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:22.669133 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-017a6340-b588-44c2-90c2-b5e7e3897c6c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:22.677253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-017a6340-b588-44c2-90c2-b5e7e3897c6c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1554 microversion: 2.1 time: 0.171149 Aug 17 23:45:22.677814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 176/348] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:22 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:23.130230 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-8b897f6c-8bd6-4b8e-8251-9dc1b54fa407 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:23.130834 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-8b897f6c-8bd6-4b8e-8251-9dc1b54fa407 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:23.137318 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8b897f6c-8bd6-4b8e-8251-9dc1b54fa407 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:23.137793 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8b897f6c-8bd6-4b8e-8251-9dc1b54fa407 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:23.138224 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8b897f6c-8bd6-4b8e-8251-9dc1b54fa407 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:23.138902 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8b897f6c-8bd6-4b8e-8251-9dc1b54fa407 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:23.139350 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8b897f6c-8bd6-4b8e-8251-9dc1b54fa407 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:23.139767 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8b897f6c-8bd6-4b8e-8251-9dc1b54fa407 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:23.265695 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8b897f6c-8bd6-4b8e-8251-9dc1b54fa407 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:23.273050 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-8b897f6c-8bd6-4b8e-8251-9dc1b54fa407 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.146659 Aug 17 23:45:23.273608 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 173/349] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:23 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:23.698518 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1d82a878-5cf9-43bf-9297-7cbddf51bf9f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:23.698999 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1d82a878-5cf9-43bf-9297-7cbddf51bf9f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:23.705483 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1d82a878-5cf9-43bf-9297-7cbddf51bf9f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:23.705974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1d82a878-5cf9-43bf-9297-7cbddf51bf9f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:23.706417 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1d82a878-5cf9-43bf-9297-7cbddf51bf9f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:23.707117 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1d82a878-5cf9-43bf-9297-7cbddf51bf9f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:23.707579 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1d82a878-5cf9-43bf-9297-7cbddf51bf9f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:23.708043 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1d82a878-5cf9-43bf-9297-7cbddf51bf9f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:23.837018 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1d82a878-5cf9-43bf-9297-7cbddf51bf9f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:23.845615 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1d82a878-5cf9-43bf-9297-7cbddf51bf9f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1554 microversion: 2.1 time: 0.151066 Aug 17 23:45:23.846151 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 177/350] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:23 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:24.292815 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5e476553-c88a-4767-92f9-1ec8bd75e500 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:24.293425 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5e476553-c88a-4767-92f9-1ec8bd75e500 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:24.299356 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5e476553-c88a-4767-92f9-1ec8bd75e500 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:24.299839 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5e476553-c88a-4767-92f9-1ec8bd75e500 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:24.300309 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5e476553-c88a-4767-92f9-1ec8bd75e500 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:24.300995 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5e476553-c88a-4767-92f9-1ec8bd75e500 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:24.301446 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5e476553-c88a-4767-92f9-1ec8bd75e500 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:24.301868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5e476553-c88a-4767-92f9-1ec8bd75e500 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:24.432915 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5e476553-c88a-4767-92f9-1ec8bd75e500 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:24.444918 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5e476553-c88a-4767-92f9-1ec8bd75e500 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.152340 Aug 17 23:45:24.444918 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 174/351] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:24 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:24.866837 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-dfc5d26f-bc84-4ef5-ba84-259620cb4a9c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:24.867450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-dfc5d26f-bc84-4ef5-ba84-259620cb4a9c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:24.874734 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dfc5d26f-bc84-4ef5-ba84-259620cb4a9c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:24.875221 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dfc5d26f-bc84-4ef5-ba84-259620cb4a9c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:24.875659 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dfc5d26f-bc84-4ef5-ba84-259620cb4a9c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:24.876441 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dfc5d26f-bc84-4ef5-ba84-259620cb4a9c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:24.876906 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dfc5d26f-bc84-4ef5-ba84-259620cb4a9c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:24.877334 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dfc5d26f-bc84-4ef5-ba84-259620cb4a9c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:25.015255 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dfc5d26f-bc84-4ef5-ba84-259620cb4a9c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:25.023346 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-dfc5d26f-bc84-4ef5-ba84-259620cb4a9c tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1554 microversion: 2.1 time: 0.160365 Aug 17 23:45:25.023897 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 178/352] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:24 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:25.468388 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0a3c9d7e-4c64-496d-b9e3-9de29a657fd5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:25.469000 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0a3c9d7e-4c64-496d-b9e3-9de29a657fd5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:25.475517 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0a3c9d7e-4c64-496d-b9e3-9de29a657fd5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:25.476018 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0a3c9d7e-4c64-496d-b9e3-9de29a657fd5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:25.476518 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0a3c9d7e-4c64-496d-b9e3-9de29a657fd5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:25.477372 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0a3c9d7e-4c64-496d-b9e3-9de29a657fd5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:25.477833 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0a3c9d7e-4c64-496d-b9e3-9de29a657fd5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:25.478263 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0a3c9d7e-4c64-496d-b9e3-9de29a657fd5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:25.506773 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:45:25.658622 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0a3c9d7e-4c64-496d-b9e3-9de29a657fd5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:25.666336 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0a3c9d7e-4c64-496d-b9e3-9de29a657fd5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.202380 Aug 17 23:45:25.666887 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 175/353] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:25 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:26.046601 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d0337b58-423e-4f8d-a3a3-79eaa0d1553a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:26.047130 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d0337b58-423e-4f8d-a3a3-79eaa0d1553a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:26.053752 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d0337b58-423e-4f8d-a3a3-79eaa0d1553a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:26.054686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d0337b58-423e-4f8d-a3a3-79eaa0d1553a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:26.054797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d0337b58-423e-4f8d-a3a3-79eaa0d1553a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:26.055532 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d0337b58-423e-4f8d-a3a3-79eaa0d1553a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:26.056004 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d0337b58-423e-4f8d-a3a3-79eaa0d1553a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:26.056429 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d0337b58-423e-4f8d-a3a3-79eaa0d1553a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:26.189938 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d0337b58-423e-4f8d-a3a3-79eaa0d1553a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:26.198000 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d0337b58-423e-4f8d-a3a3-79eaa0d1553a tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1554 microversion: 2.1 time: 0.157753 Aug 17 23:45:26.198557 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 179/354] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:26 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:26.690332 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b76e0cca-7cb0-4b9f-b5c7-1050cc8e596a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:26.691793 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b76e0cca-7cb0-4b9f-b5c7-1050cc8e596a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:26.697895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b76e0cca-7cb0-4b9f-b5c7-1050cc8e596a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:26.698498 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b76e0cca-7cb0-4b9f-b5c7-1050cc8e596a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:26.699047 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b76e0cca-7cb0-4b9f-b5c7-1050cc8e596a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:26.700461 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b76e0cca-7cb0-4b9f-b5c7-1050cc8e596a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:26.701016 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b76e0cca-7cb0-4b9f-b5c7-1050cc8e596a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:26.701541 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b76e0cca-7cb0-4b9f-b5c7-1050cc8e596a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:26.851541 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b76e0cca-7cb0-4b9f-b5c7-1050cc8e596a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:26.862702 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b76e0cca-7cb0-4b9f-b5c7-1050cc8e596a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.177745 Aug 17 23:45:26.863582 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 176/355] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:26 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:27.220090 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-011f1c16-eed9-4273-b63f-fd81d9a0e30f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:27.221379 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-011f1c16-eed9-4273-b63f-fd81d9a0e30f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:27.228189 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-011f1c16-eed9-4273-b63f-fd81d9a0e30f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:27.228984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-011f1c16-eed9-4273-b63f-fd81d9a0e30f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:27.229500 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-011f1c16-eed9-4273-b63f-fd81d9a0e30f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:27.230268 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-011f1c16-eed9-4273-b63f-fd81d9a0e30f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:27.230898 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-011f1c16-eed9-4273-b63f-fd81d9a0e30f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:27.231350 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-011f1c16-eed9-4273-b63f-fd81d9a0e30f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:27.467045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-011f1c16-eed9-4273-b63f-fd81d9a0e30f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:27.475341 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-011f1c16-eed9-4273-b63f-fd81d9a0e30f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1554 microversion: 2.1 time: 0.259713 Aug 17 23:45:27.475904 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 180/356] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:27 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1554 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:27.776825 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-dc22b772-2730-406e-bdf6-40b7321b5aaa req-d9d3abb9-0b0d-46a6-9d5b-d20149edbde2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "259ce9fa-eddc-4fe4-8789-9a13bff9ca86", "name": "network-vif-deleted", "tag": "80b1223e-6f35-4bf9-b8d0-8d3eb6f8eccc"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:45:27.794192 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-dc22b772-2730-406e-bdf6-40b7321b5aaa req-d9d3abb9-0b0d-46a6-9d5b-d20149edbde2 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:27.794899 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-dc22b772-2730-406e-bdf6-40b7321b5aaa req-d9d3abb9-0b0d-46a6-9d5b-d20149edbde2 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:27.795462 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-dc22b772-2730-406e-bdf6-40b7321b5aaa req-d9d3abb9-0b0d-46a6-9d5b-d20149edbde2 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:27.812942 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-dc22b772-2730-406e-bdf6-40b7321b5aaa req-d9d3abb9-0b0d-46a6-9d5b-d20149edbde2 service nova] Creating event network-vif-deleted:80b1223e-6f35-4bf9-b8d0-8d3eb6f8eccc for instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 on hv-cinder-82002 Aug 17 23:45:27.823274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-dc22b772-2730-406e-bdf6-40b7321b5aaa req-d9d3abb9-0b0d-46a6-9d5b-d20149edbde2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061861 Aug 17 23:45:27.824014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 177/357] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:45:27.885797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-0b37c58d-b71c-422b-8918-5e014807c2dd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:27.886890 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-0b37c58d-b71c-422b-8918-5e014807c2dd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:27.897615 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0b37c58d-b71c-422b-8918-5e014807c2dd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:27.900401 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0b37c58d-b71c-422b-8918-5e014807c2dd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:27.902013 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0b37c58d-b71c-422b-8918-5e014807c2dd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:27.903794 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0b37c58d-b71c-422b-8918-5e014807c2dd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:27.905713 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0b37c58d-b71c-422b-8918-5e014807c2dd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:27.906651 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0b37c58d-b71c-422b-8918-5e014807c2dd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:28.114486 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0b37c58d-b71c-422b-8918-5e014807c2dd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:28.123015 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-0b37c58d-b71c-422b-8918-5e014807c2dd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.242246 Aug 17 23:45:28.123584 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 181/358] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:27 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:28.497613 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9ac9b1eb-1340-47a8-94d0-af77f3a1460f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:28.498549 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9ac9b1eb-1340-47a8-94d0-af77f3a1460f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:28.519913 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9ac9b1eb-1340-47a8-94d0-af77f3a1460f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:28.522269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9ac9b1eb-1340-47a8-94d0-af77f3a1460f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:28.522725 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9ac9b1eb-1340-47a8-94d0-af77f3a1460f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:28.523687 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9ac9b1eb-1340-47a8-94d0-af77f3a1460f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:28.524403 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9ac9b1eb-1340-47a8-94d0-af77f3a1460f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:28.524838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9ac9b1eb-1340-47a8-94d0-af77f3a1460f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:28.562410 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9ac9b1eb-1340-47a8-94d0-af77f3a1460f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:28.562813 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9ac9b1eb-1340-47a8-94d0-af77f3a1460f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:28.563253 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9ac9b1eb-1340-47a8-94d0-af77f3a1460f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:28.563713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.objects.instance [None req-9ac9b1eb-1340-47a8-94d0-af77f3a1460f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lazy-loading 'fault' on Instance uuid 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 {{(pid=131395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:45:28.627043 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9ac9b1eb-1340-47a8-94d0-af77f3a1460f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c852a7d720347be87d8205716dfc15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ebf323aa7c4874bd7d0e2f2873b591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:28.636828 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9ac9b1eb-1340-47a8-94d0-af77f3a1460f tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 200 len: 1351 microversion: 2.1 time: 0.144006 Aug 17 23:45:28.637499 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 178/359] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:28 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 1351 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:29.144998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-21da4f87-f81d-4373-8912-f9859dba91a9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:29.145632 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-21da4f87-f81d-4373-8912-f9859dba91a9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:29.152408 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-21da4f87-f81d-4373-8912-f9859dba91a9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:29.153755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-21da4f87-f81d-4373-8912-f9859dba91a9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:29.154201 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-21da4f87-f81d-4373-8912-f9859dba91a9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:29.155056 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-21da4f87-f81d-4373-8912-f9859dba91a9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:29.155673 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-21da4f87-f81d-4373-8912-f9859dba91a9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:29.156428 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-21da4f87-f81d-4373-8912-f9859dba91a9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:29.301746 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-21da4f87-f81d-4373-8912-f9859dba91a9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:29.312677 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-21da4f87-f81d-4373-8912-f9859dba91a9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.168458 Aug 17 23:45:29.312677 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 182/360] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:29 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:29.658999 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c776fb35-b069-413c-8ae2-6debe719139d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:29.659607 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c776fb35-b069-413c-8ae2-6debe719139d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:29.665956 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c776fb35-b069-413c-8ae2-6debe719139d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:29.666433 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c776fb35-b069-413c-8ae2-6debe719139d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:29.666863 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c776fb35-b069-413c-8ae2-6debe719139d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:29.667546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c776fb35-b069-413c-8ae2-6debe719139d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:29.668009 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c776fb35-b069-413c-8ae2-6debe719139d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:29.668431 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c776fb35-b069-413c-8ae2-6debe719139d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:29.681303 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-c776fb35-b069-413c-8ae2-6debe719139d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] HTTP exception thrown: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c776fb35-b069-413c-8ae2-6debe719139d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Request method failure captured: Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 HTTP/1.1 Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X0hhnpKCCKXJJCcOmFBBkogPRYwyen0wSHI-hQRk6AB_dIxdd7q_S-yHdnS25iW-4wU3SjszkX4Yupj2KoECA-reXM2057kSBxw_VLyjZPZYWFCdYYRE9wIqsSo_OWq_pDCZArg5gmTYh36o4RBiLhFZvg1fpo2kVO8ja_2quErbuU Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: b7ebf323aa7c4874bd7d0e2f2873b591 Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-DeleteServersTestJSON-725735031 Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:45:29.692717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:45:29.693961 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b7ebf323aa7c4874bd7d0e2f2873b591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b7ebf323aa7c4874bd7d0e2f2873b591", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b7ebf323aa7c4874bd7d0e2f2873b591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b7ebf323aa7c4874bd7d0e2f2873b591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:45:29.693961 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-DeleteServersTestJSON-725735031 Aug 17 23:45:29.693961 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: b7ebf323aa7c4874bd7d0e2f2873b591 Aug 17 23:45:29.693961 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-DeleteServersTestJSON-725735031 Aug 17 23:45:29.693961 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-DeleteServersTestJSON-725735031-project Aug 17 23:45:29.693961 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:45:29.693961 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:45:29.693961 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 7c852a7d720347be87d8205716dfc15f Aug 17 23:45:29.693961 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-DeleteServersTestJSON-725735031-project Aug 17 23:45:29.693961 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:45:29.693961 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. Aug 17 23:45:29.693961 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': '259ce9fa-eddc-4fe4-8789-9a13bff9ca86'} Aug 17 23:45:29.694672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:45:29.694672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:45:29.694672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:45:29.694672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:45:29.694672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:45:29.694672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:45:29.694672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:45:29.694672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:45:29.694672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:45:29.694672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:45:29.694672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. Aug 17 23:45:29.694672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:45:29.694672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:45:29.694672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:45:29.694672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:45:29.694672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:45:29.694672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:45:29.694672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:45:29.694672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:45:29.694672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:45:29.695838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:45:29.695838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:45:29.695838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:45:29.695838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:45:29.695838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:45:29.695838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:45:29.695838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:45:29.695838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. Aug 17 23:45:29.695838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:45:29.695838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:45:29.695838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:45:29.695838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:45:29.695838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:45:29.695838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:45:29.695838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:45:29.695838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:45:29.695838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. Aug 17 23:45:29.695838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:45:29.696946 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c776fb35-b069-413c-8ae2-6debe719139d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Returning 404 to user: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:45:29.696946 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c776fb35-b069-413c-8ae2-6debe719139d tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 404 len: 111 microversion: 2.1 time: 0.038954 Aug 17 23:45:29.696946 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 179/361] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:29 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:45:29.808086 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-26114a39-6135-4716-8d0c-8e01b1d85916 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:29.811176 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-26114a39-6135-4716-8d0c-8e01b1d85916 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:29.817432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26114a39-6135-4716-8d0c-8e01b1d85916 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:29.818044 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26114a39-6135-4716-8d0c-8e01b1d85916 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:29.818657 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26114a39-6135-4716-8d0c-8e01b1d85916 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:29.819396 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26114a39-6135-4716-8d0c-8e01b1d85916 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:29.820072 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26114a39-6135-4716-8d0c-8e01b1d85916 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:29.820347 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26114a39-6135-4716-8d0c-8e01b1d85916 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:29.841394 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-26114a39-6135-4716-8d0c-8e01b1d85916 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] HTTP exception thrown: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-26114a39-6135-4716-8d0c-8e01b1d85916 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Request method failure captured: Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86/os-volume_attachments HTTP/1.1 Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X0hhnpKCCKXJJCcOmFBBkogPRYwyen0wSHI-hQRk6AB_dIxdd7q_S-yHdnS25iW-4wU3SjszkX4Yupj2KoECA-reXM2057kSBxw_VLyjZPZYWFCdYYRE9wIqsSo_OWq_pDCZArg5gmTYh36o4RBiLhFZvg1fpo2kVO8ja_2quErbuU Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: b7ebf323aa7c4874bd7d0e2f2873b591 Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-DeleteServersTestJSON-725735031 Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:45:29.848730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:45:29.849987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b7ebf323aa7c4874bd7d0e2f2873b591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b7ebf323aa7c4874bd7d0e2f2873b591", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b7ebf323aa7c4874bd7d0e2f2873b591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b7ebf323aa7c4874bd7d0e2f2873b591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:45:29.849987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-DeleteServersTestJSON-725735031 Aug 17 23:45:29.849987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: b7ebf323aa7c4874bd7d0e2f2873b591 Aug 17 23:45:29.849987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-DeleteServersTestJSON-725735031 Aug 17 23:45:29.849987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-DeleteServersTestJSON-725735031-project Aug 17 23:45:29.849987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:45:29.849987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:45:29.849987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 7c852a7d720347be87d8205716dfc15f Aug 17 23:45:29.849987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-DeleteServersTestJSON-725735031-project Aug 17 23:45:29.849987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:45:29.849987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. Aug 17 23:45:29.849987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'server_id': '259ce9fa-eddc-4fe4-8789-9a13bff9ca86'} Aug 17 23:45:29.850648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:45:29.850648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:45:29.850648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:45:29.850648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:45:29.850648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:45:29.850648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:45:29.850648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:45:29.850648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:45:29.850648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:45:29.850648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:45:29.850648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. Aug 17 23:45:29.850648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:45:29.850648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:45:29.850648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:45:29.850648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:45:29.850648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:45:29.850648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:45:29.850648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:45:29.850648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:45:29.850648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:45:29.851732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:45:29.851732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 17 23:45:29.851732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 23:45:29.851732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 17 23:45:29.851732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 23:45:29.851732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 17 23:45:29.851732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 17 23:45:29.851732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:45:29.851732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:45:29.851732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. Aug 17 23:45:29.851732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:45:29.851732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:45:29.851732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:45:29.851732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:45:29.851732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:45:29.851732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:45:29.851732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:45:29.851732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:45:29.851732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. Aug 17 23:45:29.851732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:45:29.852873 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-26114a39-6135-4716-8d0c-8e01b1d85916 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Returning 404 to user: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:45:29.852873 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-26114a39-6135-4716-8d0c-8e01b1d85916 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046396 Aug 17 23:45:29.852873 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 183/362] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:45:29 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:45:30.329869 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2397b585-c1ff-4f05-bb2d-e85288d1421e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:30.330598 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2397b585-c1ff-4f05-bb2d-e85288d1421e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:30.336601 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2397b585-c1ff-4f05-bb2d-e85288d1421e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:30.337098 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2397b585-c1ff-4f05-bb2d-e85288d1421e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:30.337521 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2397b585-c1ff-4f05-bb2d-e85288d1421e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:30.338262 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2397b585-c1ff-4f05-bb2d-e85288d1421e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:30.338743 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2397b585-c1ff-4f05-bb2d-e85288d1421e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:30.339356 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2397b585-c1ff-4f05-bb2d-e85288d1421e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:30.493496 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2397b585-c1ff-4f05-bb2d-e85288d1421e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:30.501302 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2397b585-c1ff-4f05-bb2d-e85288d1421e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.175421 Aug 17 23:45:30.501899 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 180/363] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:30 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:31.077123 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-16ad7708-4be4-4c0e-adb4-e06c8c224cb8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:31.077629 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-16ad7708-4be4-4c0e-adb4-e06c8c224cb8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:31.084496 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-16ad7708-4be4-4c0e-adb4-e06c8c224cb8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:31.085009 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-16ad7708-4be4-4c0e-adb4-e06c8c224cb8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:31.085434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-16ad7708-4be4-4c0e-adb4-e06c8c224cb8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:31.086140 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-16ad7708-4be4-4c0e-adb4-e06c8c224cb8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:31.086775 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-16ad7708-4be4-4c0e-adb4-e06c8c224cb8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:31.087207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-16ad7708-4be4-4c0e-adb4-e06c8c224cb8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:31.102724 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-16ad7708-4be4-4c0e-adb4-e06c8c224cb8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] HTTP exception thrown: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-16ad7708-4be4-4c0e-adb4-e06c8c224cb8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Request method failure captured: Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: DELETE /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 HTTP/1.1 Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X0hhnpKCCKXJJCcOmFBBkogPRYwyen0wSHI-hQRk6AB_dIxdd7q_S-yHdnS25iW-4wU3SjszkX4Yupj2KoECA-reXM2057kSBxw_VLyjZPZYWFCdYYRE9wIqsSo_OWq_pDCZArg5gmTYh36o4RBiLhFZvg1fpo2kVO8ja_2quErbuU Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: b7ebf323aa7c4874bd7d0e2f2873b591 Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-DeleteServersTestJSON-725735031 Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:45:31.104958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:45:31.106269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b7ebf323aa7c4874bd7d0e2f2873b591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b7ebf323aa7c4874bd7d0e2f2873b591", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b7ebf323aa7c4874bd7d0e2f2873b591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b7ebf323aa7c4874bd7d0e2f2873b591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:45:31.106269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-DeleteServersTestJSON-725735031 Aug 17 23:45:31.106269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: b7ebf323aa7c4874bd7d0e2f2873b591 Aug 17 23:45:31.106269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-DeleteServersTestJSON-725735031 Aug 17 23:45:31.106269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-DeleteServersTestJSON-725735031-project Aug 17 23:45:31.106269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:45:31.106269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:45:31.106269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 7c852a7d720347be87d8205716dfc15f Aug 17 23:45:31.106269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-DeleteServersTestJSON-725735031-project Aug 17 23:45:31.106269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:45:31.106269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. Aug 17 23:45:31.106269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': '259ce9fa-eddc-4fe4-8789-9a13bff9ca86'} Aug 17 23:45:31.107344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:45:31.107344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:45:31.107344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:45:31.107344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:45:31.107344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:45:31.107344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:45:31.107344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:45:31.107344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:45:31.107344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:45:31.107344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:45:31.107344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. Aug 17 23:45:31.107344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:45:31.107344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:45:31.107344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:45:31.107344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:45:31.107344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:45:31.107344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:45:31.107344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:45:31.107344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:45:31.107344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:45:31.108732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:45:31.108732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 23:45:31.108732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 23:45:31.108732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 23:45:31.108732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 23:45:31.108732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:45:31.108732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:45:31.108732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:45:31.108732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:45:31.108732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. Aug 17 23:45:31.108732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:45:31.108732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:45:31.108732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:45:31.108732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:45:31.108732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:45:31.108732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:45:31.108732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:45:31.108732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:45:31.108732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. Aug 17 23:45:31.108732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:45:31.110218 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-16ad7708-4be4-4c0e-adb4-e06c8c224cb8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Returning 404 to user: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:45:31.110218 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-16ad7708-4be4-4c0e-adb4-e06c8c224cb8 tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "DELETE /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 404 len: 111 microversion: 2.1 time: 0.033857 Aug 17 23:45:31.110218 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 184/364] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:45:31 2022] DELETE /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:45:31.115770 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b4cc0a0d-e8b6-4170-8a99-c2f5dbaa95dd tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:31.116473 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b4cc0a0d-e8b6-4170-8a99-c2f5dbaa95dd tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] [instance: 259ce9fa-eddc-4fe4-8789-9a13bff9ca86] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:31.122497 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b4cc0a0d-e8b6-4170-8a99-c2f5dbaa95dd tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:31.122990 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b4cc0a0d-e8b6-4170-8a99-c2f5dbaa95dd tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:31.123431 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b4cc0a0d-e8b6-4170-8a99-c2f5dbaa95dd tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:31.124163 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b4cc0a0d-e8b6-4170-8a99-c2f5dbaa95dd tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:31.124624 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b4cc0a0d-e8b6-4170-8a99-c2f5dbaa95dd tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:31.125056 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b4cc0a0d-e8b6-4170-8a99-c2f5dbaa95dd tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:31.140307 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-b4cc0a0d-e8b6-4170-8a99-c2f5dbaa95dd tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] HTTP exception thrown: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b4cc0a0d-e8b6-4170-8a99-c2f5dbaa95dd tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Request method failure captured: Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 HTTP/1.1 Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X0hhnpKCCKXJJCcOmFBBkogPRYwyen0wSHI-hQRk6AB_dIxdd7q_S-yHdnS25iW-4wU3SjszkX4Yupj2KoECA-reXM2057kSBxw_VLyjZPZYWFCdYYRE9wIqsSo_OWq_pDCZArg5gmTYh36o4RBiLhFZvg1fpo2kVO8ja_2quErbuU Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: b7ebf323aa7c4874bd7d0e2f2873b591 Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-DeleteServersTestJSON-725735031 Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:45:31.141847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:45:31.143270 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b7ebf323aa7c4874bd7d0e2f2873b591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b7ebf323aa7c4874bd7d0e2f2873b591", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b7ebf323aa7c4874bd7d0e2f2873b591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b7ebf323aa7c4874bd7d0e2f2873b591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:45:31.143270 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-DeleteServersTestJSON-725735031 Aug 17 23:45:31.143270 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: b7ebf323aa7c4874bd7d0e2f2873b591 Aug 17 23:45:31.143270 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-DeleteServersTestJSON-725735031 Aug 17 23:45:31.143270 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-DeleteServersTestJSON-725735031-project Aug 17 23:45:31.143270 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:45:31.143270 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:45:31.143270 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 7c852a7d720347be87d8205716dfc15f Aug 17 23:45:31.143270 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-DeleteServersTestJSON-725735031-project Aug 17 23:45:31.143270 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:45:31.143270 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. Aug 17 23:45:31.143270 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': '259ce9fa-eddc-4fe4-8789-9a13bff9ca86'} Aug 17 23:45:31.144119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:45:31.144119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:45:31.144119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:45:31.144119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:45:31.144119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:45:31.144119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:45:31.144119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:45:31.144119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:45:31.144119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:45:31.144119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:45:31.144119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. Aug 17 23:45:31.144119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:45:31.144119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:45:31.144119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:45:31.144119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:45:31.144119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:45:31.144119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:45:31.144119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:45:31.144119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:45:31.144119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:45:31.145426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:45:31.145426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:45:31.145426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:45:31.145426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:45:31.145426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:45:31.145426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:45:31.145426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:45:31.145426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. Aug 17 23:45:31.145426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:45:31.145426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:45:31.145426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:45:31.145426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:45:31.145426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:45:31.145426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:45:31.145426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:45:31.145426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:45:31.145426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. Aug 17 23:45:31.145426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:45:31.146571 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b4cc0a0d-e8b6-4170-8a99-c2f5dbaa95dd tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] Returning 404 to user: Instance 259ce9fa-eddc-4fe4-8789-9a13bff9ca86 could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:45:31.146571 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b4cc0a0d-e8b6-4170-8a99-c2f5dbaa95dd tempest-DeleteServersTestJSON-725735031 tempest-DeleteServersTestJSON-725735031-project] 10.222.0.26 "GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86" status: 404 len: 111 microversion: 2.1 time: 0.034540 Aug 17 23:45:31.160874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 181/365] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:31 2022] GET /compute/v2.1/servers/259ce9fa-eddc-4fe4-8789-9a13bff9ca86 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:45:31.522203 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-0969f6b6-3895-4472-8834-db211db3e853 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:31.522823 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-0969f6b6-3895-4472-8834-db211db3e853 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:31.528756 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0969f6b6-3895-4472-8834-db211db3e853 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:31.529433 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0969f6b6-3895-4472-8834-db211db3e853 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:31.529905 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0969f6b6-3895-4472-8834-db211db3e853 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:31.530682 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0969f6b6-3895-4472-8834-db211db3e853 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:31.531151 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0969f6b6-3895-4472-8834-db211db3e853 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:31.531585 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0969f6b6-3895-4472-8834-db211db3e853 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:31.903776 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0969f6b6-3895-4472-8834-db211db3e853 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:31.907312 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=100 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:45:31.913068 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-0969f6b6-3895-4472-8834-db211db3e853 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.395122 Aug 17 23:45:31.913721 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 185/366] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:31 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:45:32.934539 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f1003d84-fc82-4b92-b31c-f0c308dd1484 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:32.935402 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f1003d84-fc82-4b92-b31c-f0c308dd1484 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:32.943040 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f1003d84-fc82-4b92-b31c-f0c308dd1484 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:32.943542 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f1003d84-fc82-4b92-b31c-f0c308dd1484 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:32.944000 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f1003d84-fc82-4b92-b31c-f0c308dd1484 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:32.944711 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f1003d84-fc82-4b92-b31c-f0c308dd1484 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:32.945836 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f1003d84-fc82-4b92-b31c-f0c308dd1484 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:32.946276 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f1003d84-fc82-4b92-b31c-f0c308dd1484 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:33.171733 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f1003d84-fc82-4b92-b31c-f0c308dd1484 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:33.181004 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f1003d84-fc82-4b92-b31c-f0c308dd1484 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.250276 Aug 17 23:45:33.195460 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 182/367] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:32 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:34.202607 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-62a1bd06-11c3-4280-ba82-d75c956f19ad tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:34.203541 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-62a1bd06-11c3-4280-ba82-d75c956f19ad tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:34.210674 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-62a1bd06-11c3-4280-ba82-d75c956f19ad tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:34.211196 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-62a1bd06-11c3-4280-ba82-d75c956f19ad tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:34.211617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-62a1bd06-11c3-4280-ba82-d75c956f19ad tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:34.212363 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-62a1bd06-11c3-4280-ba82-d75c956f19ad tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:34.212823 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-62a1bd06-11c3-4280-ba82-d75c956f19ad tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:34.213253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-62a1bd06-11c3-4280-ba82-d75c956f19ad tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:34.353141 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-62a1bd06-11c3-4280-ba82-d75c956f19ad tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:34.362528 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-62a1bd06-11c3-4280-ba82-d75c956f19ad tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.164215 Aug 17 23:45:34.364028 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 186/368] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:34 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:35.384754 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-08829b11-da81-40a9-a911-1c61aa9989ac tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:35.385776 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-08829b11-da81-40a9-a911-1c61aa9989ac tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:35.398275 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-08829b11-da81-40a9-a911-1c61aa9989ac tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:35.399463 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-08829b11-da81-40a9-a911-1c61aa9989ac tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:35.400154 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-08829b11-da81-40a9-a911-1c61aa9989ac tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:35.401172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-08829b11-da81-40a9-a911-1c61aa9989ac tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:35.401903 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-08829b11-da81-40a9-a911-1c61aa9989ac tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:35.403275 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-08829b11-da81-40a9-a911-1c61aa9989ac tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:35.590889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-08829b11-da81-40a9-a911-1c61aa9989ac tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:35.600393 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-08829b11-da81-40a9-a911-1c61aa9989ac tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1523 microversion: 2.1 time: 0.219389 Aug 17 23:45:35.601507 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 183/369] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:35 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:36.631466 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e35a51f2-6f8f-4ce1-b840-63c219428d82 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:36.634040 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e35a51f2-6f8f-4ce1-b840-63c219428d82 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:36.641471 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e35a51f2-6f8f-4ce1-b840-63c219428d82 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:36.641957 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e35a51f2-6f8f-4ce1-b840-63c219428d82 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:36.642387 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e35a51f2-6f8f-4ce1-b840-63c219428d82 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:36.643266 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e35a51f2-6f8f-4ce1-b840-63c219428d82 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:36.643725 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e35a51f2-6f8f-4ce1-b840-63c219428d82 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:36.644183 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e35a51f2-6f8f-4ce1-b840-63c219428d82 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:36.887596 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e35a51f2-6f8f-4ce1-b840-63c219428d82 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:36.896080 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e35a51f2-6f8f-4ce1-b840-63c219428d82 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1503 microversion: 2.1 time: 0.272008 Aug 17 23:45:36.896744 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 187/370] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:36 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1503 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:36.917079 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-60ed3e50-8ea8-43f6-8ad4-5c1d48d95145 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:36.917718 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-60ed3e50-8ea8-43f6-8ad4-5c1d48d95145 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:36.926243 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-60ed3e50-8ea8-43f6-8ad4-5c1d48d95145 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:36.926949 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-60ed3e50-8ea8-43f6-8ad4-5c1d48d95145 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:36.927488 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-60ed3e50-8ea8-43f6-8ad4-5c1d48d95145 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:36.928379 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-60ed3e50-8ea8-43f6-8ad4-5c1d48d95145 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:36.928916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-60ed3e50-8ea8-43f6-8ad4-5c1d48d95145 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:36.929434 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-60ed3e50-8ea8-43f6-8ad4-5c1d48d95145 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:37.084120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-60ed3e50-8ea8-43f6-8ad4-5c1d48d95145 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:37.092208 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-60ed3e50-8ea8-43f6-8ad4-5c1d48d95145 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1516 microversion: 2.1 time: 0.179369 Aug 17 23:45:37.092802 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 184/371] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:36 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1516 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:38.531666 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d02fa4fe-016a-4462-8b1b-1f7a46b6db0d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:45:38.533934 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d02fa4fe-016a-4462-8b1b-1f7a46b6db0d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:38.540430 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d02fa4fe-016a-4462-8b1b-1f7a46b6db0d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:38.540923 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d02fa4fe-016a-4462-8b1b-1f7a46b6db0d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:38.541371 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d02fa4fe-016a-4462-8b1b-1f7a46b6db0d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:38.542080 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d02fa4fe-016a-4462-8b1b-1f7a46b6db0d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:38.542543 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d02fa4fe-016a-4462-8b1b-1f7a46b6db0d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:38.543473 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d02fa4fe-016a-4462-8b1b-1f7a46b6db0d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:38.568040 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.objects.instance [None req-d02fa4fe-016a-4462-8b1b-1f7a46b6db0d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lazy-loading 'flavor' on Instance uuid ad01f85b-96a2-474a-85f3-7f7c1fd43db7 {{(pid=131394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:45:38.650750 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d02fa4fe-016a-4462-8b1b-1f7a46b6db0d tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "POST /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7/action" status: 200 len: 32 microversion: 2.1 time: 0.123031 Aug 17 23:45:38.651400 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 188/372] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 17 23:45:38 2022] POST /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7/action => generated 32 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 23:45:38.667064 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f546ef64-0af1-4869-912a-4b8aad7f8f3a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:38.671089 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f546ef64-0af1-4869-912a-4b8aad7f8f3a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:38.680646 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f546ef64-0af1-4869-912a-4b8aad7f8f3a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:38.681222 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f546ef64-0af1-4869-912a-4b8aad7f8f3a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:38.681922 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f546ef64-0af1-4869-912a-4b8aad7f8f3a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:38.687590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f546ef64-0af1-4869-912a-4b8aad7f8f3a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:38.688562 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f546ef64-0af1-4869-912a-4b8aad7f8f3a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:38.689449 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f546ef64-0af1-4869-912a-4b8aad7f8f3a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:39.190281 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f546ef64-0af1-4869-912a-4b8aad7f8f3a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:39.202499 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f546ef64-0af1-4869-912a-4b8aad7f8f3a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1522 microversion: 2.1 time: 0.544839 Aug 17 23:45:39.206435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 185/373] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:38 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1522 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:40.231014 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-aaecc38d-d702-410d-826b-a76144aae27e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:40.231014 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-aaecc38d-d702-410d-826b-a76144aae27e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:40.242993 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aaecc38d-d702-410d-826b-a76144aae27e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:40.246477 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aaecc38d-d702-410d-826b-a76144aae27e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:40.248458 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aaecc38d-d702-410d-826b-a76144aae27e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:40.249297 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aaecc38d-d702-410d-826b-a76144aae27e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:40.253334 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aaecc38d-d702-410d-826b-a76144aae27e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:40.254446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aaecc38d-d702-410d-826b-a76144aae27e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:40.513275 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-aaecc38d-d702-410d-826b-a76144aae27e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:40.525907 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-aaecc38d-d702-410d-826b-a76144aae27e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1522 microversion: 2.1 time: 0.302029 Aug 17 23:45:40.528123 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 189/374] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:40 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:41.518605 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-94a84a24-ecc1-42f5-ae85-5a0ed6c24474 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Action: 'create', calling method: .version_select at 0x7f85fe307ca0>, body: {"keypair": {"name": "tempest-keypair-269979743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEdCzom0yXiWXol0WObHbCoYVIOb5JQYNx2RqAN5Dz6fvCV5KB0EdtHvQrXYz4SzE1pqTIU71juhaTeOxRWk/6hz/FSKyCgBZy6bxZoEXPpRGufOqeivVpglr9fUk1wAQ=="}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:45:41.531499 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:45:41.544733 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-94a84a24-ecc1-42f5-ae85-5a0ed6c24474 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Getting quotas for project ec8246e3b9904e7a8fe4a04269ab0afe. Resources: {'key_pairs'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:45:41.549232 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-94a84a24-ecc1-42f5-ae85-5a0ed6c24474 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Getting quotas for user 047293a64a9f4857be1621e77094d367 and project ec8246e3b9904e7a8fe4a04269ab0afe. Resources: {'key_pairs'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:45:41.551303 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-74dc8928-4ef0-4d90-8cd7-0e244d0694b3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:41.552059 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-74dc8928-4ef0-4d90-8cd7-0e244d0694b3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:41.559797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-74dc8928-4ef0-4d90-8cd7-0e244d0694b3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:41.560318 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-74dc8928-4ef0-4d90-8cd7-0e244d0694b3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:41.561025 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-74dc8928-4ef0-4d90-8cd7-0e244d0694b3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:41.561799 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-74dc8928-4ef0-4d90-8cd7-0e244d0694b3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:41.562477 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-74dc8928-4ef0-4d90-8cd7-0e244d0694b3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:41.563075 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-74dc8928-4ef0-4d90-8cd7-0e244d0694b3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:41.595701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-94a84a24-ecc1-42f5-ae85-5a0ed6c24474 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.241268 Aug 17 23:45:41.601261 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 186/375] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Aug 17 23:45:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:45:41.723713 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-74dc8928-4ef0-4d90-8cd7-0e244d0694b3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:41.733105 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-74dc8928-4ef0-4d90-8cd7-0e244d0694b3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1522 microversion: 2.1 time: 0.188634 Aug 17 23:45:41.734159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 190/376] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:41 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:45:42.755600 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-bc924690-1ac9-4e38-90e2-99e1e197b3b9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:42.763274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-bc924690-1ac9-4e38-90e2-99e1e197b3b9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:42.769480 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bc924690-1ac9-4e38-90e2-99e1e197b3b9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:42.769971 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bc924690-1ac9-4e38-90e2-99e1e197b3b9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:42.770618 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bc924690-1ac9-4e38-90e2-99e1e197b3b9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:42.771503 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bc924690-1ac9-4e38-90e2-99e1e197b3b9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:42.772000 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bc924690-1ac9-4e38-90e2-99e1e197b3b9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:42.772584 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bc924690-1ac9-4e38-90e2-99e1e197b3b9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:42.919816 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-34200fac-0ef9-452a-b3b0-0f815a9830ce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-82021008", "imageRef": "a3cf81e5-e973-4c08-b1da-4e8f104b52a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f5926b6b-855d-424e-99e1-23c773a9098b"}], "security_groups": [{"name": "tempest-securitygroup--1164723371"}], "key_name": "tempest-keypair-269979743", "user_data": "}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:45:42.957427 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-bc924690-1ac9-4e38-90e2-99e1e197b3b9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:42.974046 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-bc924690-1ac9-4e38-90e2-99e1e197b3b9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1522 microversion: 2.1 time: 0.223370 Aug 17 23:45:42.989160 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 187/377] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:42 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:43.088213 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.network.neutron [None req-34200fac-0ef9-452a-b3b0-0f815a9830ce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] validate_networks() for [('f5926b6b-855d-424e-99e1-23c773a9098b', None, None, None, None, None)] {{(pid=131394) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:45:43.479305 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-34200fac-0ef9-452a-b3b0-0f815a9830ce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Flavor limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:45:43.479741 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-34200fac-0ef9-452a-b3b0-0f815a9830ce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Image limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:45:43.481926 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-34200fac-0ef9-452a-b3b0-0f815a9830ce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Flavor pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:45:43.481926 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-34200fac-0ef9-452a-b3b0-0f815a9830ce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Image pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:45:43.482626 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-34200fac-0ef9-452a-b3b0-0f815a9830ce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:45:43.491941 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-34200fac-0ef9-452a-b3b0-0f815a9830ce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:43.492506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-34200fac-0ef9-452a-b3b0-0f815a9830ce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:43.492988 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-34200fac-0ef9-452a-b3b0-0f815a9830ce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:43.493717 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-34200fac-0ef9-452a-b3b0-0f815a9830ce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:43.494167 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-34200fac-0ef9-452a-b3b0-0f815a9830ce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:43.494589 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-34200fac-0ef9-452a-b3b0-0f815a9830ce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:43.512140 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-34200fac-0ef9-452a-b3b0-0f815a9830ce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Getting quotas for project ec8246e3b9904e7a8fe4a04269ab0afe. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:45:43.516132 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-34200fac-0ef9-452a-b3b0-0f815a9830ce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Getting quotas for user 047293a64a9f4857be1621e77094d367 and project ec8246e3b9904e7a8fe4a04269ab0afe. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:45:43.527042 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-34200fac-0ef9-452a-b3b0-0f815a9830ce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Going to run 1 instances... {{(pid=131394) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:45:43.529986 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-34200fac-0ef9-452a-b3b0-0f815a9830ce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a3cf81e5-e973-4c08-b1da-4e8f104b52a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131394) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:45:43.575840 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-34200fac-0ef9-452a-b3b0-0f815a9830ce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.660988 Aug 17 23:45:43.576772 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 191/378] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 17 23:45:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 23:45:43.587988 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-19c77135-f95c-4ac1-aafa-51b5e8257055 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:43.589140 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-19c77135-f95c-4ac1-aafa-51b5e8257055 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:43.670566 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-19c77135-f95c-4ac1-aafa-51b5e8257055 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:43.677943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-19c77135-f95c-4ac1-aafa-51b5e8257055 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1235 microversion: 2.1 time: 0.093816 Aug 17 23:45:43.678886 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 188/379] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:43 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1235 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:43.998837 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8b87c7fa-6baa-4e97-9a45-d7f3971b053a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:44.004125 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8b87c7fa-6baa-4e97-9a45-d7f3971b053a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:44.008900 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8b87c7fa-6baa-4e97-9a45-d7f3971b053a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:44.009496 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8b87c7fa-6baa-4e97-9a45-d7f3971b053a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:44.009944 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8b87c7fa-6baa-4e97-9a45-d7f3971b053a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:44.010644 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8b87c7fa-6baa-4e97-9a45-d7f3971b053a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:44.011089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8b87c7fa-6baa-4e97-9a45-d7f3971b053a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:44.012249 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8b87c7fa-6baa-4e97-9a45-d7f3971b053a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:44.185863 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-8b87c7fa-6baa-4e97-9a45-d7f3971b053a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:44.194460 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8b87c7fa-6baa-4e97-9a45-d7f3971b053a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1522 microversion: 2.1 time: 0.201061 Aug 17 23:45:44.195031 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 192/380] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:43 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:44.698424 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-4dcb97d8-5730-4103-a06e-4f5964fc924e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:44.699034 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-4dcb97d8-5730-4103-a06e-4f5964fc924e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:44.705548 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4dcb97d8-5730-4103-a06e-4f5964fc924e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:44.706160 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4dcb97d8-5730-4103-a06e-4f5964fc924e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:44.706499 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4dcb97d8-5730-4103-a06e-4f5964fc924e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:44.707222 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4dcb97d8-5730-4103-a06e-4f5964fc924e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:44.707676 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4dcb97d8-5730-4103-a06e-4f5964fc924e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:44.708133 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4dcb97d8-5730-4103-a06e-4f5964fc924e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:44.805079 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-4dcb97d8-5730-4103-a06e-4f5964fc924e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:44.823027 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-4dcb97d8-5730-4103-a06e-4f5964fc924e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1287 microversion: 2.1 time: 0.128293 Aug 17 23:45:44.826229 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 189/381] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:44 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1287 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:45.217003 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-85590c5e-a0ac-4659-aef1-6cad884f996c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:45.217618 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-85590c5e-a0ac-4659-aef1-6cad884f996c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:45.224096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85590c5e-a0ac-4659-aef1-6cad884f996c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:45.224520 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85590c5e-a0ac-4659-aef1-6cad884f996c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:45.224965 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85590c5e-a0ac-4659-aef1-6cad884f996c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:45.225675 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85590c5e-a0ac-4659-aef1-6cad884f996c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:45.226135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85590c5e-a0ac-4659-aef1-6cad884f996c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:45.226579 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85590c5e-a0ac-4659-aef1-6cad884f996c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:45.404330 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-85590c5e-a0ac-4659-aef1-6cad884f996c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:45.417120 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-85590c5e-a0ac-4659-aef1-6cad884f996c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1522 microversion: 2.1 time: 0.204005 Aug 17 23:45:45.428043 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 193/382] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:45 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:45.846885 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a03441da-cb27-4f05-851a-96b4a2c18584 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:45.847510 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a03441da-cb27-4f05-851a-96b4a2c18584 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:45.853848 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a03441da-cb27-4f05-851a-96b4a2c18584 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:45.854341 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a03441da-cb27-4f05-851a-96b4a2c18584 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:45.854783 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a03441da-cb27-4f05-851a-96b4a2c18584 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:45.855493 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a03441da-cb27-4f05-851a-96b4a2c18584 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:45.856180 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a03441da-cb27-4f05-851a-96b4a2c18584 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:45.856614 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a03441da-cb27-4f05-851a-96b4a2c18584 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:46.095890 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a03441da-cb27-4f05-851a-96b4a2c18584 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:46.103929 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a03441da-cb27-4f05-851a-96b4a2c18584 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1361 microversion: 2.1 time: 0.260894 Aug 17 23:45:46.105135 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 190/383] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:45 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1361 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:46.443747 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-41999658-5546-491a-9170-5532c1136a07 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:46.445190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-41999658-5546-491a-9170-5532c1136a07 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:46.455728 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-41999658-5546-491a-9170-5532c1136a07 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:46.456324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-41999658-5546-491a-9170-5532c1136a07 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:46.458136 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-41999658-5546-491a-9170-5532c1136a07 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:46.459230 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-41999658-5546-491a-9170-5532c1136a07 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:46.459762 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-41999658-5546-491a-9170-5532c1136a07 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:46.460785 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-41999658-5546-491a-9170-5532c1136a07 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:46.497541 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-9921b0ad-7b3f-4d91-946e-a9239dec2e98 req-b30cc7a2-1033-44e3-84da-b5699bddfd96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16b92554-3f2a-482c-bcf5-1f5f05631227", "tag": "c9a2d576-b43b-452b-bd44-887c08463ddb"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:45:46.513555 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-9921b0ad-7b3f-4d91-946e-a9239dec2e98 req-b30cc7a2-1033-44e3-84da-b5699bddfd96 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:46.514334 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-9921b0ad-7b3f-4d91-946e-a9239dec2e98 req-b30cc7a2-1033-44e3-84da-b5699bddfd96 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:46.514926 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-9921b0ad-7b3f-4d91-946e-a9239dec2e98 req-b30cc7a2-1033-44e3-84da-b5699bddfd96 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:46.533288 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-9921b0ad-7b3f-4d91-946e-a9239dec2e98 req-b30cc7a2-1033-44e3-84da-b5699bddfd96 service nova] Creating event network-changed:c9a2d576-b43b-452b-bd44-887c08463ddb for instance 16b92554-3f2a-482c-bcf5-1f5f05631227 on hv-cinder-82002 Aug 17 23:45:46.545503 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-9921b0ad-7b3f-4d91-946e-a9239dec2e98 req-b30cc7a2-1033-44e3-84da-b5699bddfd96 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052267 Aug 17 23:45:46.546397 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 191/384] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:45:46.614365 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-41999658-5546-491a-9170-5532c1136a07 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:46.622677 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-41999658-5546-491a-9170-5532c1136a07 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1522 microversion: 2.1 time: 0.183879 Aug 17 23:45:46.623445 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 194/385] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:46 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:47.125973 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c1edc898-4372-439f-b435-60981cfc6b83 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:47.136321 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c1edc898-4372-439f-b435-60981cfc6b83 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:47.143161 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1edc898-4372-439f-b435-60981cfc6b83 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:47.143642 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1edc898-4372-439f-b435-60981cfc6b83 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:47.144110 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1edc898-4372-439f-b435-60981cfc6b83 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:47.144817 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1edc898-4372-439f-b435-60981cfc6b83 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:47.145283 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1edc898-4372-439f-b435-60981cfc6b83 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:47.145704 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1edc898-4372-439f-b435-60981cfc6b83 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:47.391574 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c1edc898-4372-439f-b435-60981cfc6b83 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:47.404399 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c1edc898-4372-439f-b435-60981cfc6b83 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1361 microversion: 2.1 time: 0.282647 Aug 17 23:45:47.405402 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 192/386] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:47 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1361 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:47.643135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-64ff5707-cd14-472d-bf4a-d07dd7cab78f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:47.643731 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-64ff5707-cd14-472d-bf4a-d07dd7cab78f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:47.650606 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-64ff5707-cd14-472d-bf4a-d07dd7cab78f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:47.651101 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-64ff5707-cd14-472d-bf4a-d07dd7cab78f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:47.651542 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-64ff5707-cd14-472d-bf4a-d07dd7cab78f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:47.652781 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-64ff5707-cd14-472d-bf4a-d07dd7cab78f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:47.653239 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-64ff5707-cd14-472d-bf4a-d07dd7cab78f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:47.653663 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-64ff5707-cd14-472d-bf4a-d07dd7cab78f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:47.796652 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-64ff5707-cd14-472d-bf4a-d07dd7cab78f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:47.804673 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-64ff5707-cd14-472d-bf4a-d07dd7cab78f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1522 microversion: 2.1 time: 0.165812 Aug 17 23:45:47.805563 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 195/387] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:47 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:48.426799 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-77c3cb2f-4224-44b5-a5ca-eaa81ea5d7d6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:48.427527 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-77c3cb2f-4224-44b5-a5ca-eaa81ea5d7d6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:48.434071 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-77c3cb2f-4224-44b5-a5ca-eaa81ea5d7d6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:48.434553 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-77c3cb2f-4224-44b5-a5ca-eaa81ea5d7d6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:48.434982 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-77c3cb2f-4224-44b5-a5ca-eaa81ea5d7d6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:48.435675 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-77c3cb2f-4224-44b5-a5ca-eaa81ea5d7d6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:48.436160 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-77c3cb2f-4224-44b5-a5ca-eaa81ea5d7d6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:48.436607 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-77c3cb2f-4224-44b5-a5ca-eaa81ea5d7d6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:48.569254 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-77c3cb2f-4224-44b5-a5ca-eaa81ea5d7d6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:48.576606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-77c3cb2f-4224-44b5-a5ca-eaa81ea5d7d6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1361 microversion: 2.1 time: 0.153949 Aug 17 23:45:48.577166 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 193/388] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:48 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:48.826938 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a63c43a0-9f49-450b-b03b-db19240128fc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:48.827479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a63c43a0-9f49-450b-b03b-db19240128fc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:48.833887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a63c43a0-9f49-450b-b03b-db19240128fc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:48.834370 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a63c43a0-9f49-450b-b03b-db19240128fc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:48.834810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a63c43a0-9f49-450b-b03b-db19240128fc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:48.835501 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a63c43a0-9f49-450b-b03b-db19240128fc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:48.835986 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a63c43a0-9f49-450b-b03b-db19240128fc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:48.836412 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a63c43a0-9f49-450b-b03b-db19240128fc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:48.970369 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a63c43a0-9f49-450b-b03b-db19240128fc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:48.979449 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a63c43a0-9f49-450b-b03b-db19240128fc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1522 microversion: 2.1 time: 0.157100 Aug 17 23:45:48.980027 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 196/389] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:48 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:49.597856 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ccde4960-21ca-4424-9fab-0b9328eb2e01 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:49.598367 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ccde4960-21ca-4424-9fab-0b9328eb2e01 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:49.604979 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccde4960-21ca-4424-9fab-0b9328eb2e01 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:49.605499 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccde4960-21ca-4424-9fab-0b9328eb2e01 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:49.605936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccde4960-21ca-4424-9fab-0b9328eb2e01 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:49.606673 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccde4960-21ca-4424-9fab-0b9328eb2e01 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:49.607134 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccde4960-21ca-4424-9fab-0b9328eb2e01 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:49.607597 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccde4960-21ca-4424-9fab-0b9328eb2e01 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:49.736829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ccde4960-21ca-4424-9fab-0b9328eb2e01 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:49.744301 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ccde4960-21ca-4424-9fab-0b9328eb2e01 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1361 microversion: 2.1 time: 0.150484 Aug 17 23:45:49.744864 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 194/390] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:49 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:50.002574 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8256af5d-4c71-4ed2-a13a-a96c62ccc4e7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:50.003194 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8256af5d-4c71-4ed2-a13a-a96c62ccc4e7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:50.009506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8256af5d-4c71-4ed2-a13a-a96c62ccc4e7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:50.009994 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8256af5d-4c71-4ed2-a13a-a96c62ccc4e7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:50.010440 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8256af5d-4c71-4ed2-a13a-a96c62ccc4e7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:50.011130 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8256af5d-4c71-4ed2-a13a-a96c62ccc4e7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:50.016051 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8256af5d-4c71-4ed2-a13a-a96c62ccc4e7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:50.016051 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8256af5d-4c71-4ed2-a13a-a96c62ccc4e7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:50.020892 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a7810a46-0328-4e5a-8023-1342740704c1 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-672036047", "imageRef": "a3cf81e5-e973-4c08-b1da-4e8f104b52a1", "flavorRef": "452"}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:45:50.073104 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.network.neutron [None req-a7810a46-0328-4e5a-8023-1342740704c1 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] validate_networks() for None {{(pid=131395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:45:50.144854 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-8256af5d-4c71-4ed2-a13a-a96c62ccc4e7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:50.152183 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8256af5d-4c71-4ed2-a13a-a96c62ccc4e7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1522 microversion: 2.1 time: 0.153400 Aug 17 23:45:50.152751 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 197/391] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:49 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:50.344239 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-a7810a46-0328-4e5a-8023-1342740704c1 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Flavor limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:45:50.344660 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-a7810a46-0328-4e5a-8023-1342740704c1 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Image limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:45:50.345227 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-a7810a46-0328-4e5a-8023-1342740704c1 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Flavor pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:45:50.345635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-a7810a46-0328-4e5a-8023-1342740704c1 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Image pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:45:50.346041 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-a7810a46-0328-4e5a-8023-1342740704c1 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:45:50.355626 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a7810a46-0328-4e5a-8023-1342740704c1 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:50.356160 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a7810a46-0328-4e5a-8023-1342740704c1 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:50.356604 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a7810a46-0328-4e5a-8023-1342740704c1 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:50.357334 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a7810a46-0328-4e5a-8023-1342740704c1 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:50.357798 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a7810a46-0328-4e5a-8023-1342740704c1 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:50.358229 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a7810a46-0328-4e5a-8023-1342740704c1 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:50.375175 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-a7810a46-0328-4e5a-8023-1342740704c1 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Getting quotas for project 9f504189f5a949cdae85a009e3b182b1. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:45:50.379134 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-a7810a46-0328-4e5a-8023-1342740704c1 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Getting quotas for user f34ca182eb1c4627beb18ac1256607f8 and project 9f504189f5a949cdae85a009e3b182b1. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:45:50.390147 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a7810a46-0328-4e5a-8023-1342740704c1 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Going to run 1 instances... {{(pid=131395) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:45:50.392402 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a7810a46-0328-4e5a-8023-1342740704c1 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a3cf81e5-e973-4c08-b1da-4e8f104b52a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:45:50.441919 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a7810a46-0328-4e5a-8023-1342740704c1 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.424696 Aug 17 23:45:50.443026 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 195/392] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 17 23:45:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 23:45:50.453880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-4e269e00-4612-42fd-a0bc-853aa4d495d7 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:50.454614 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-4e269e00-4612-42fd-a0bc-853aa4d495d7 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:50.456993 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:45:50.514769 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-4e269e00-4612-42fd-a0bc-853aa4d495d7 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:50.528050 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-4e269e00-4612-42fd-a0bc-853aa4d495d7 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1214 microversion: 2.1 time: 0.078503 Aug 17 23:45:50.528607 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 198/393] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:50 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:50.765216 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-cc31dd71-f007-4f03-91c8-f0ac2e0446f4 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:50.765941 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-cc31dd71-f007-4f03-91c8-f0ac2e0446f4 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:50.772909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cc31dd71-f007-4f03-91c8-f0ac2e0446f4 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:50.773393 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cc31dd71-f007-4f03-91c8-f0ac2e0446f4 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:50.773828 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cc31dd71-f007-4f03-91c8-f0ac2e0446f4 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:50.774511 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cc31dd71-f007-4f03-91c8-f0ac2e0446f4 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:50.774962 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cc31dd71-f007-4f03-91c8-f0ac2e0446f4 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:50.775375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cc31dd71-f007-4f03-91c8-f0ac2e0446f4 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:50.905357 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-cc31dd71-f007-4f03-91c8-f0ac2e0446f4 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:50.913061 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-cc31dd71-f007-4f03-91c8-f0ac2e0446f4 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1361 microversion: 2.1 time: 0.152353 Aug 17 23:45:50.913611 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 196/394] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:50 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:45:51.173416 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1dc9c074-bbe8-48da-a494-9ce1657055eb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:51.173948 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1dc9c074-bbe8-48da-a494-9ce1657055eb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:51.180364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1dc9c074-bbe8-48da-a494-9ce1657055eb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:51.180849 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1dc9c074-bbe8-48da-a494-9ce1657055eb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:51.181294 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1dc9c074-bbe8-48da-a494-9ce1657055eb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:51.181979 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1dc9c074-bbe8-48da-a494-9ce1657055eb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:51.182444 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1dc9c074-bbe8-48da-a494-9ce1657055eb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:51.182870 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1dc9c074-bbe8-48da-a494-9ce1657055eb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:51.306329 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1dc9c074-bbe8-48da-a494-9ce1657055eb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:51.314390 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1dc9c074-bbe8-48da-a494-9ce1657055eb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1522 microversion: 2.1 time: 0.145048 Aug 17 23:45:51.314949 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 199/395] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:51 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:51.548973 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-4001c1fe-6116-40bd-9c66-9bae22c701f4 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:51.549612 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-4001c1fe-6116-40bd-9c66-9bae22c701f4 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:51.555497 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4001c1fe-6116-40bd-9c66-9bae22c701f4 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:51.556144 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4001c1fe-6116-40bd-9c66-9bae22c701f4 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:51.556589 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4001c1fe-6116-40bd-9c66-9bae22c701f4 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:51.557376 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4001c1fe-6116-40bd-9c66-9bae22c701f4 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:51.557836 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4001c1fe-6116-40bd-9c66-9bae22c701f4 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:51.558267 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4001c1fe-6116-40bd-9c66-9bae22c701f4 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:51.562339 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=100 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:45:51.617252 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-4001c1fe-6116-40bd-9c66-9bae22c701f4 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:51.624722 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-4001c1fe-6116-40bd-9c66-9bae22c701f4 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1218 microversion: 2.1 time: 0.079684 Aug 17 23:45:51.626384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 197/396] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:51 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:51.933384 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-84328128-187a-47cf-aa95-32f82c754876 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:51.934034 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-84328128-187a-47cf-aa95-32f82c754876 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:51.940099 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-84328128-187a-47cf-aa95-32f82c754876 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:51.940585 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-84328128-187a-47cf-aa95-32f82c754876 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:51.941026 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-84328128-187a-47cf-aa95-32f82c754876 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:51.941812 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-84328128-187a-47cf-aa95-32f82c754876 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:51.942272 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-84328128-187a-47cf-aa95-32f82c754876 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:51.942703 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-84328128-187a-47cf-aa95-32f82c754876 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:52.245517 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-84328128-187a-47cf-aa95-32f82c754876 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:52.253424 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-84328128-187a-47cf-aa95-32f82c754876 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1361 microversion: 2.1 time: 0.323962 Aug 17 23:45:52.253988 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 200/397] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:51 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1361 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:52.334380 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-326617cf-2b43-4b32-9a4f-e0f78b2c7fd4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:52.334986 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-326617cf-2b43-4b32-9a4f-e0f78b2c7fd4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:52.340870 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-326617cf-2b43-4b32-9a4f-e0f78b2c7fd4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:52.341348 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-326617cf-2b43-4b32-9a4f-e0f78b2c7fd4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:52.341778 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-326617cf-2b43-4b32-9a4f-e0f78b2c7fd4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:52.342454 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-326617cf-2b43-4b32-9a4f-e0f78b2c7fd4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:52.342904 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-326617cf-2b43-4b32-9a4f-e0f78b2c7fd4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:52.343343 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-326617cf-2b43-4b32-9a4f-e0f78b2c7fd4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:52.645624 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c0f4a494-9287-4223-9b16-7795eb39a620 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:52.646326 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c0f4a494-9287-4223-9b16-7795eb39a620 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:52.653240 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0f4a494-9287-4223-9b16-7795eb39a620 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:52.654063 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0f4a494-9287-4223-9b16-7795eb39a620 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:52.654976 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0f4a494-9287-4223-9b16-7795eb39a620 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:52.655409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0f4a494-9287-4223-9b16-7795eb39a620 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:52.656118 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0f4a494-9287-4223-9b16-7795eb39a620 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:52.656632 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0f4a494-9287-4223-9b16-7795eb39a620 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:52.726606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-326617cf-2b43-4b32-9a4f-e0f78b2c7fd4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:52.734914 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c0f4a494-9287-4223-9b16-7795eb39a620 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:52.735341 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-326617cf-2b43-4b32-9a4f-e0f78b2c7fd4 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1522 microversion: 2.1 time: 0.404660 Aug 17 23:45:52.735909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 198/398] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:52 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:52.743996 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c0f4a494-9287-4223-9b16-7795eb39a620 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1210 microversion: 2.1 time: 0.102288 Aug 17 23:45:52.750706 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 201/399] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:52 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1210 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:45:53.274850 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f25d618b-510a-4032-9462-e8e947dd9e1e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:53.275792 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f25d618b-510a-4032-9462-e8e947dd9e1e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:53.281988 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f25d618b-510a-4032-9462-e8e947dd9e1e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:53.282481 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f25d618b-510a-4032-9462-e8e947dd9e1e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:53.282920 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f25d618b-510a-4032-9462-e8e947dd9e1e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:53.284198 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f25d618b-510a-4032-9462-e8e947dd9e1e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:53.284313 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f25d618b-510a-4032-9462-e8e947dd9e1e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:53.284707 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f25d618b-510a-4032-9462-e8e947dd9e1e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:53.475341 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f25d618b-510a-4032-9462-e8e947dd9e1e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:53.483274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f25d618b-510a-4032-9462-e8e947dd9e1e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1361 microversion: 2.1 time: 0.212425 Aug 17 23:45:53.483828 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 199/400] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:53 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:53.759262 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-128c8ba4-db77-457d-bdb9-f9b4a91e5471 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:53.760813 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-128c8ba4-db77-457d-bdb9-f9b4a91e5471 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:53.766514 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-6c474cfc-4e8b-4ae9-bed9-21d57a97c4d4 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:53.767323 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-6c474cfc-4e8b-4ae9-bed9-21d57a97c4d4 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:53.768782 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=2 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:45:53.770429 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-128c8ba4-db77-457d-bdb9-f9b4a91e5471 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:53.771060 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-128c8ba4-db77-457d-bdb9-f9b4a91e5471 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:53.771592 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-128c8ba4-db77-457d-bdb9-f9b4a91e5471 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:53.772677 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-128c8ba4-db77-457d-bdb9-f9b4a91e5471 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:53.773390 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-128c8ba4-db77-457d-bdb9-f9b4a91e5471 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:53.774015 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-128c8ba4-db77-457d-bdb9-f9b4a91e5471 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:53.774751 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6c474cfc-4e8b-4ae9-bed9-21d57a97c4d4 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:53.775992 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6c474cfc-4e8b-4ae9-bed9-21d57a97c4d4 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:53.776670 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6c474cfc-4e8b-4ae9-bed9-21d57a97c4d4 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:53.777693 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6c474cfc-4e8b-4ae9-bed9-21d57a97c4d4 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:53.778404 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6c474cfc-4e8b-4ae9-bed9-21d57a97c4d4 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:53.779503 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6c474cfc-4e8b-4ae9-bed9-21d57a97c4d4 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:53.780411 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:45:53.861663 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-6c474cfc-4e8b-4ae9-bed9-21d57a97c4d4 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:53.869851 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-6c474cfc-4e8b-4ae9-bed9-21d57a97c4d4 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1272 microversion: 2.1 time: 0.108640 Aug 17 23:45:53.882333 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 200/401] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:53 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1272 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:45:53.921238 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-128c8ba4-db77-457d-bdb9-f9b4a91e5471 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:53.929062 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-128c8ba4-db77-457d-bdb9-f9b4a91e5471 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1522 microversion: 2.1 time: 0.175846 Aug 17 23:45:53.929662 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 202/402] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:53 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:54.504191 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2d1e63b8-03ee-4528-b38e-49807ef4ad40 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:54.504758 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2d1e63b8-03ee-4528-b38e-49807ef4ad40 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:54.510589 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2d1e63b8-03ee-4528-b38e-49807ef4ad40 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:54.511062 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2d1e63b8-03ee-4528-b38e-49807ef4ad40 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:54.511491 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2d1e63b8-03ee-4528-b38e-49807ef4ad40 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:54.512205 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2d1e63b8-03ee-4528-b38e-49807ef4ad40 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:54.512653 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2d1e63b8-03ee-4528-b38e-49807ef4ad40 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:54.513068 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2d1e63b8-03ee-4528-b38e-49807ef4ad40 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:54.648272 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2d1e63b8-03ee-4528-b38e-49807ef4ad40 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:54.659133 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2d1e63b8-03ee-4528-b38e-49807ef4ad40 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1361 microversion: 2.1 time: 0.158904 Aug 17 23:45:54.673667 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 201/403] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:54 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:54.892536 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-4669cc75-001f-4a8e-b2fa-6481bb35e75e tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:54.893157 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-4669cc75-001f-4a8e-b2fa-6481bb35e75e tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:54.899696 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4669cc75-001f-4a8e-b2fa-6481bb35e75e tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:54.900253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4669cc75-001f-4a8e-b2fa-6481bb35e75e tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:54.900696 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4669cc75-001f-4a8e-b2fa-6481bb35e75e tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:54.901437 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4669cc75-001f-4a8e-b2fa-6481bb35e75e tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:54.902543 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4669cc75-001f-4a8e-b2fa-6481bb35e75e tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:54.902976 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4669cc75-001f-4a8e-b2fa-6481bb35e75e tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:54.950841 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-273930cc-3515-4e98-a68c-782695f976a2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:54.951472 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-273930cc-3515-4e98-a68c-782695f976a2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:54.957710 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-273930cc-3515-4e98-a68c-782695f976a2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:54.958201 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-273930cc-3515-4e98-a68c-782695f976a2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:54.958644 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-273930cc-3515-4e98-a68c-782695f976a2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:54.959338 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-273930cc-3515-4e98-a68c-782695f976a2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:54.959797 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-273930cc-3515-4e98-a68c-782695f976a2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:54.960256 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-273930cc-3515-4e98-a68c-782695f976a2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:55.033545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-4669cc75-001f-4a8e-b2fa-6481bb35e75e tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:55.041366 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-4669cc75-001f-4a8e-b2fa-6481bb35e75e tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1314 microversion: 2.1 time: 0.152740 Aug 17 23:45:55.041936 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 203/404] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:54 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:55.089861 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-273930cc-3515-4e98-a68c-782695f976a2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:55.097308 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-273930cc-3515-4e98-a68c-782695f976a2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1522 microversion: 2.1 time: 0.150837 Aug 17 23:45:55.097861 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 202/405] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:54 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:45:55.680696 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-91daf030-a357-4550-bce0-dfbfae02a50d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:55.681320 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-91daf030-a357-4550-bce0-dfbfae02a50d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:55.687227 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-91daf030-a357-4550-bce0-dfbfae02a50d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:55.687711 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-91daf030-a357-4550-bce0-dfbfae02a50d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:55.688194 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-91daf030-a357-4550-bce0-dfbfae02a50d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:55.688880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-91daf030-a357-4550-bce0-dfbfae02a50d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:55.689336 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-91daf030-a357-4550-bce0-dfbfae02a50d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:55.689762 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-91daf030-a357-4550-bce0-dfbfae02a50d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:55.822076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-91daf030-a357-4550-bce0-dfbfae02a50d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:55.830020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-91daf030-a357-4550-bce0-dfbfae02a50d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1361 microversion: 2.1 time: 0.153224 Aug 17 23:45:55.830578 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 204/406] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:55 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:56.062080 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-4fbe6e69-8672-4089-8306-5327d454040f tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:56.062718 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-4fbe6e69-8672-4089-8306-5327d454040f tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:56.068643 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4fbe6e69-8672-4089-8306-5327d454040f tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:56.069127 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4fbe6e69-8672-4089-8306-5327d454040f tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:56.069570 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4fbe6e69-8672-4089-8306-5327d454040f tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:56.070269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4fbe6e69-8672-4089-8306-5327d454040f tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:56.070722 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4fbe6e69-8672-4089-8306-5327d454040f tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:56.071146 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4fbe6e69-8672-4089-8306-5327d454040f tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:56.117836 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-08a64a1f-e9de-4152-ae06-2409819dfd1c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:56.118431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-08a64a1f-e9de-4152-ae06-2409819dfd1c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:56.125239 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08a64a1f-e9de-4152-ae06-2409819dfd1c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:56.125738 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08a64a1f-e9de-4152-ae06-2409819dfd1c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:56.126178 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08a64a1f-e9de-4152-ae06-2409819dfd1c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:56.126886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08a64a1f-e9de-4152-ae06-2409819dfd1c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:56.127349 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08a64a1f-e9de-4152-ae06-2409819dfd1c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:56.127781 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08a64a1f-e9de-4152-ae06-2409819dfd1c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:56.258387 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-08a64a1f-e9de-4152-ae06-2409819dfd1c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:56.266566 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-08a64a1f-e9de-4152-ae06-2409819dfd1c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1522 microversion: 2.1 time: 0.152564 Aug 17 23:45:56.267068 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 205/407] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:56 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:45:56.281817 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-4fbe6e69-8672-4089-8306-5327d454040f tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:56.289482 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-4fbe6e69-8672-4089-8306-5327d454040f tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1314 microversion: 2.1 time: 0.231886 Aug 17 23:45:56.290043 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 203/408] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:56 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:56.477615 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-c79e23d5-36a8-4271-9bd5-e48be30bb6e5 req-1f19e099-0748-40b6-a277-733430c61236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cc622bb-1f93-429a-b616-ebe52d601923", "tag": "fc183e87-2a03-4fa2-b930-971be7b21603"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:45:56.488025 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-c79e23d5-36a8-4271-9bd5-e48be30bb6e5 req-1f19e099-0748-40b6-a277-733430c61236 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:56.488504 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-c79e23d5-36a8-4271-9bd5-e48be30bb6e5 req-1f19e099-0748-40b6-a277-733430c61236 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:56.488943 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-c79e23d5-36a8-4271-9bd5-e48be30bb6e5 req-1f19e099-0748-40b6-a277-733430c61236 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:56.500305 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-c79e23d5-36a8-4271-9bd5-e48be30bb6e5 req-1f19e099-0748-40b6-a277-733430c61236 service nova] Creating event network-changed:fc183e87-2a03-4fa2-b930-971be7b21603 for instance 2cc622bb-1f93-429a-b616-ebe52d601923 on hv-cinder-82002 Aug 17 23:45:56.505254 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-c79e23d5-36a8-4271-9bd5-e48be30bb6e5 req-1f19e099-0748-40b6-a277-733430c61236 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031328 Aug 17 23:45:56.505850 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 206/409] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:45:56.850508 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-64ae4da8-a124-4361-97d7-79fc9c2f1dde tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:56.851121 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-64ae4da8-a124-4361-97d7-79fc9c2f1dde tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:56.857072 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-64ae4da8-a124-4361-97d7-79fc9c2f1dde tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:56.857553 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-64ae4da8-a124-4361-97d7-79fc9c2f1dde tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:56.857986 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-64ae4da8-a124-4361-97d7-79fc9c2f1dde tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:56.858671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-64ae4da8-a124-4361-97d7-79fc9c2f1dde tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:56.859127 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-64ae4da8-a124-4361-97d7-79fc9c2f1dde tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:56.859575 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-64ae4da8-a124-4361-97d7-79fc9c2f1dde tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:56.988631 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-64ae4da8-a124-4361-97d7-79fc9c2f1dde tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:56.996692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-64ae4da8-a124-4361-97d7-79fc9c2f1dde tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1361 microversion: 2.1 time: 0.150024 Aug 17 23:45:56.997246 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 204/410] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:56 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:57.215055 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-54c74461-49fc-43af-bb9f-de9a1d6bf9d5 req-23f41096-7c46-4b8e-8029-c935da33bb4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b92554-3f2a-482c-bcf5-1f5f05631227", "name": "network-vif-plugged", "status": "completed", "tag": "c9a2d576-b43b-452b-bd44-887c08463ddb"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:45:57.225861 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-54c74461-49fc-43af-bb9f-de9a1d6bf9d5 req-23f41096-7c46-4b8e-8029-c935da33bb4b service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:57.226336 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-54c74461-49fc-43af-bb9f-de9a1d6bf9d5 req-23f41096-7c46-4b8e-8029-c935da33bb4b service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:57.226767 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-54c74461-49fc-43af-bb9f-de9a1d6bf9d5 req-23f41096-7c46-4b8e-8029-c935da33bb4b service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:57.239792 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-54c74461-49fc-43af-bb9f-de9a1d6bf9d5 req-23f41096-7c46-4b8e-8029-c935da33bb4b service nova] Creating event network-vif-plugged:c9a2d576-b43b-452b-bd44-887c08463ddb for instance 16b92554-3f2a-482c-bcf5-1f5f05631227 on hv-cinder-82002 Aug 17 23:45:57.244550 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-54c74461-49fc-43af-bb9f-de9a1d6bf9d5 req-23f41096-7c46-4b8e-8029-c935da33bb4b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034826 Aug 17 23:45:57.245133 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 207/411] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:45:57.287000 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f75afc9b-f58d-4ffe-80a1-42a659316acf tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:57.287615 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f75afc9b-f58d-4ffe-80a1-42a659316acf tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:57.294025 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f75afc9b-f58d-4ffe-80a1-42a659316acf tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:57.294511 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f75afc9b-f58d-4ffe-80a1-42a659316acf tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:57.294957 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f75afc9b-f58d-4ffe-80a1-42a659316acf tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:57.295646 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f75afc9b-f58d-4ffe-80a1-42a659316acf tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:57.296152 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f75afc9b-f58d-4ffe-80a1-42a659316acf tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:57.296577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f75afc9b-f58d-4ffe-80a1-42a659316acf tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:57.311177 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b8c6df01-5349-46a8-a1de-7e479051a40f tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:57.311805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b8c6df01-5349-46a8-a1de-7e479051a40f tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:57.317896 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8c6df01-5349-46a8-a1de-7e479051a40f tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:57.318384 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8c6df01-5349-46a8-a1de-7e479051a40f tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:57.318825 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8c6df01-5349-46a8-a1de-7e479051a40f tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:57.319511 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8c6df01-5349-46a8-a1de-7e479051a40f tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:57.319983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8c6df01-5349-46a8-a1de-7e479051a40f tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:57.320415 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8c6df01-5349-46a8-a1de-7e479051a40f tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:57.430074 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f75afc9b-f58d-4ffe-80a1-42a659316acf tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:57.437615 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f75afc9b-f58d-4ffe-80a1-42a659316acf tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1522 microversion: 2.1 time: 0.154751 Aug 17 23:45:57.438177 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 205/412] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:57 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:57.450994 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b8c6df01-5349-46a8-a1de-7e479051a40f tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:57.457308 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b8c6df01-5349-46a8-a1de-7e479051a40f tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1314 microversion: 2.1 time: 0.150962 Aug 17 23:45:57.457868 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 208/413] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:57 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:45:58.017501 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1e249be6-b40b-4ad7-b53a-22c702a6c7a5 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:58.018113 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-1e249be6-b40b-4ad7-b53a-22c702a6c7a5 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:58.023987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1e249be6-b40b-4ad7-b53a-22c702a6c7a5 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:58.024474 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1e249be6-b40b-4ad7-b53a-22c702a6c7a5 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:58.024908 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1e249be6-b40b-4ad7-b53a-22c702a6c7a5 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:58.025601 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1e249be6-b40b-4ad7-b53a-22c702a6c7a5 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:58.026057 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1e249be6-b40b-4ad7-b53a-22c702a6c7a5 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:58.026482 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1e249be6-b40b-4ad7-b53a-22c702a6c7a5 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:58.161765 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1e249be6-b40b-4ad7-b53a-22c702a6c7a5 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:58.169124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-1e249be6-b40b-4ad7-b53a-22c702a6c7a5 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1361 microversion: 2.1 time: 0.155459 Aug 17 23:45:58.169682 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 206/414] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:58 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:58.457919 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8ae1543c-b976-47c6-a89d-33f4a70ae825 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:58.458534 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8ae1543c-b976-47c6-a89d-33f4a70ae825 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:58.464896 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8ae1543c-b976-47c6-a89d-33f4a70ae825 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:58.465379 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8ae1543c-b976-47c6-a89d-33f4a70ae825 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:58.465817 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8ae1543c-b976-47c6-a89d-33f4a70ae825 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:58.466503 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8ae1543c-b976-47c6-a89d-33f4a70ae825 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:58.466957 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8ae1543c-b976-47c6-a89d-33f4a70ae825 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:58.467381 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8ae1543c-b976-47c6-a89d-33f4a70ae825 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:58.478446 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5d4f9b1c-c7b8-4d52-b9f4-723fdf0a87bf tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:58.479052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5d4f9b1c-c7b8-4d52-b9f4-723fdf0a87bf tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:58.484957 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d4f9b1c-c7b8-4d52-b9f4-723fdf0a87bf tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:58.485437 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d4f9b1c-c7b8-4d52-b9f4-723fdf0a87bf tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:58.485871 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d4f9b1c-c7b8-4d52-b9f4-723fdf0a87bf tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:58.486555 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d4f9b1c-c7b8-4d52-b9f4-723fdf0a87bf tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:58.487007 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d4f9b1c-c7b8-4d52-b9f4-723fdf0a87bf tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:58.487430 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d4f9b1c-c7b8-4d52-b9f4-723fdf0a87bf tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:58.600609 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-8ae1543c-b976-47c6-a89d-33f4a70ae825 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:58.608563 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8ae1543c-b976-47c6-a89d-33f4a70ae825 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1522 microversion: 2.1 time: 0.154510 Aug 17 23:45:58.609157 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 209/415] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:58 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:58.615702 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5d4f9b1c-c7b8-4d52-b9f4-723fdf0a87bf tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:58.623984 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5d4f9b1c-c7b8-4d52-b9f4-723fdf0a87bf tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1314 microversion: 2.1 time: 0.149287 Aug 17 23:45:58.624530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 207/416] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:58 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:45:59.189838 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c0d89423-1962-489f-b964-0ab435a4b396 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:59.190559 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c0d89423-1962-489f-b964-0ab435a4b396 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:59.198191 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0d89423-1962-489f-b964-0ab435a4b396 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:59.198680 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0d89423-1962-489f-b964-0ab435a4b396 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:59.199120 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0d89423-1962-489f-b964-0ab435a4b396 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:59.199813 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0d89423-1962-489f-b964-0ab435a4b396 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:59.200290 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0d89423-1962-489f-b964-0ab435a4b396 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:59.200710 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0d89423-1962-489f-b964-0ab435a4b396 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:59.332074 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c0d89423-1962-489f-b964-0ab435a4b396 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:59.340019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c0d89423-1962-489f-b964-0ab435a4b396 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1361 microversion: 2.1 time: 0.153609 Aug 17 23:45:59.340522 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 210/417] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:59 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:59.630630 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-50d9273b-ca38-4302-a4d7-8508798c5aa2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:59.631183 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-50d9273b-ca38-4302-a4d7-8508798c5aa2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:59.637515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-50d9273b-ca38-4302-a4d7-8508798c5aa2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:59.637998 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-50d9273b-ca38-4302-a4d7-8508798c5aa2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:59.638431 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-50d9273b-ca38-4302-a4d7-8508798c5aa2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:59.639367 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-50d9273b-ca38-4302-a4d7-8508798c5aa2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:59.639822 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-50d9273b-ca38-4302-a4d7-8508798c5aa2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:59.640266 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-50d9273b-ca38-4302-a4d7-8508798c5aa2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:59.643943 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-65d21d3b-141a-4510-9ea2-5002d2960cdf tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:59.644578 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-65d21d3b-141a-4510-9ea2-5002d2960cdf tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:59.650961 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-65d21d3b-141a-4510-9ea2-5002d2960cdf tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:59.651449 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-65d21d3b-141a-4510-9ea2-5002d2960cdf tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:59.652473 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-65d21d3b-141a-4510-9ea2-5002d2960cdf tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:59.653169 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-65d21d3b-141a-4510-9ea2-5002d2960cdf tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:59.653629 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-65d21d3b-141a-4510-9ea2-5002d2960cdf tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:59.654056 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-65d21d3b-141a-4510-9ea2-5002d2960cdf tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:59.773334 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-50d9273b-ca38-4302-a4d7-8508798c5aa2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:59.781008 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-50d9273b-ca38-4302-a4d7-8508798c5aa2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1502 microversion: 2.1 time: 0.154297 Aug 17 23:45:59.781582 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 208/418] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:59 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:45:59.781800 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-65d21d3b-141a-4510-9ea2-5002d2960cdf tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:45:59.789428 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-65d21d3b-141a-4510-9ea2-5002d2960cdf tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1314 microversion: 2.1 time: 0.149240 Aug 17 23:45:59.789979 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 211/419] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:59 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:45:59.802147 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-92b189ec-4909-4a28-beee-9d8518827632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fc62f4b-640d-44ad-a060-0c2c1df4d9e8"}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:45:59.804585 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-92b189ec-4909-4a28-beee-9d8518827632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:59.811027 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-92b189ec-4909-4a28-beee-9d8518827632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:59.811505 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-92b189ec-4909-4a28-beee-9d8518827632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:59.811937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-92b189ec-4909-4a28-beee-9d8518827632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:59.812640 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-92b189ec-4909-4a28-beee-9d8518827632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:59.813095 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-92b189ec-4909-4a28-beee-9d8518827632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:59.813515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-92b189ec-4909-4a28-beee-9d8518827632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:59.836354 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-92b189ec-4909-4a28-beee-9d8518827632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] HTTP exception thrown: Cannot 'attach_volume' instance ad01f85b-96a2-474a-85f3-7f7c1fd43db7 while it is in vm_state rescued Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-92b189ec-4909-4a28-beee-9d8518827632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Request method failure captured: Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: POST /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7/os-volume_attachments HTTP/1.1 Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 74 Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X0diO02GDVsees0ow7IkXKzIuul6QEmJ2Nv7i9HfBPD7e2j-jzLKTFcjJ8KBABEjBcsMQiTuyNcmjGYaRHOtX6NetLnvMesRTx1pmEyyYO3llMGBjIGxbDgoTaetHgZcL5KAnV1LdBDF1RGbkUDkZ3WWB_pyjiCJNMMeOwgFJjlQuk Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: dbc0fe79b67f4446b1a4c36c068f9b00 Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1988082284 Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:45:59.838236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:45:59.839717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dbc0fe79b67f4446b1a4c36c068f9b00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dbc0fe79b67f4446b1a4c36c068f9b00", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dbc0fe79b67f4446b1a4c36c068f9b00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dbc0fe79b67f4446b1a4c36c068f9b00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:45:59.839717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1988082284 Aug 17 23:45:59.839717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: dbc0fe79b67f4446b1a4c36c068f9b00 Aug 17 23:45:59.839717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1988082284 Aug 17 23:45:59.839717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-ServerRescueNegativeTestJSON-1988082284-project Aug 17 23:45:59.839717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:45:59.839717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:45:59.839717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: c67dec924b7e4f0aa0874e6e21879889 Aug 17 23:45:59.839717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1988082284-project Aug 17 23:45:59.839717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Aug 17 23:45:59.839717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {"volumeAttachment": {"volumeId": "6fc62f4b-640d-44ad-a060-0c2c1df4d9e8"}} Aug 17 23:45:59.839717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:45:59.840701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Cannot 'attach_volume' instance ad01f85b-96a2-474a-85f3-7f7c1fd43db7 while it is in vm_state rescued Aug 17 23:45:59.840701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'server_id': 'ad01f85b-96a2-474a-85f3-7f7c1fd43db7', 'body': {'volumeAttachment': {'volumeId': '6fc62f4b-640d-44ad-a060-0c2c1df4d9e8'}}} Aug 17 23:45:59.840701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:45:59.840701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:45:59.840701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 23:45:59.840701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 23:45:59.840701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 23:45:59.840701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 23:45:59.840701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 17 23:45:59.840701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 17 23:45:59.840701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ad01f85b-96a2-474a-85f3-7f7c1fd43db7 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 17 23:45:59.840701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:45:59.840701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:45:59.840701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:45:59.840701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:45:59.840701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:45:59.840701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:45:59.840701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:45:59.840701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:45:59.842172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:45:59.842172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:45:59.842172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 23:45:59.842172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 23:45:59.842172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 23:45:59.842172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 23:45:59.842172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 23:45:59.842172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 23:45:59.842172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 17 23:45:59.842172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 17 23:45:59.842172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 17 23:45:59.842172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 17 23:45:59.842172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ad01f85b-96a2-474a-85f3-7f7c1fd43db7 while it is in vm_state rescued Aug 17 23:45:59.842172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:45:59.842172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:45:59.842172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:45:59.842172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:45:59.842172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:45:59.842172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:45:59.843555 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:45:59.843555 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:45:59.843555 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ad01f85b-96a2-474a-85f3-7f7c1fd43db7 while it is in vm_state rescued Aug 17 23:45:59.843555 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:45:59.843555 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-92b189ec-4909-4a28-beee-9d8518827632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Returning 409 to user: Cannot 'attach_volume' instance ad01f85b-96a2-474a-85f3-7f7c1fd43db7 while it is in vm_state rescued {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:45:59.843555 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-92b189ec-4909-4a28-beee-9d8518827632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "POST /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041523 Aug 17 23:45:59.843555 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 209/420] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 17 23:45:59 2022] POST /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 17 23:45:59.849082 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ac997ce6-4cdb-44f8-9ac1-211acd1e5292 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:45:59.849617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ac997ce6-4cdb-44f8-9ac1-211acd1e5292 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:59.855514 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac997ce6-4cdb-44f8-9ac1-211acd1e5292 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:59.856041 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac997ce6-4cdb-44f8-9ac1-211acd1e5292 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:59.856482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac997ce6-4cdb-44f8-9ac1-211acd1e5292 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:59.857166 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac997ce6-4cdb-44f8-9ac1-211acd1e5292 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:59.857623 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac997ce6-4cdb-44f8-9ac1-211acd1e5292 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:59.858050 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac997ce6-4cdb-44f8-9ac1-211acd1e5292 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:59.920771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ac997ce6-4cdb-44f8-9ac1-211acd1e5292 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "POST /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7/action" status: 202 len: 0 microversion: 2.1 time: 0.075215 Aug 17 23:45:59.924228 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 212/421] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 17 23:45:59 2022] POST /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:45:59.929293 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0331a331-f384-46af-aee5-0ff0c26e5975 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:45:59.929904 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0331a331-f384-46af-aee5-0ff0c26e5975 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:45:59.936327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0331a331-f384-46af-aee5-0ff0c26e5975 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:59.936828 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0331a331-f384-46af-aee5-0ff0c26e5975 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:59.937264 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0331a331-f384-46af-aee5-0ff0c26e5975 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:45:59.937944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0331a331-f384-46af-aee5-0ff0c26e5975 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:45:59.938394 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0331a331-f384-46af-aee5-0ff0c26e5975 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:45:59.938812 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0331a331-f384-46af-aee5-0ff0c26e5975 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:00.070981 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0331a331-f384-46af-aee5-0ff0c26e5975 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:00.079748 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0331a331-f384-46af-aee5-0ff0c26e5975 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1510 microversion: 2.1 time: 0.154157 Aug 17 23:46:00.080660 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 210/422] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:45:59 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:00.361718 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-6ffb15d4-d84d-49a6-b8c6-f2da16738164 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:00.362422 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-6ffb15d4-d84d-49a6-b8c6-f2da16738164 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:00.368508 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6ffb15d4-d84d-49a6-b8c6-f2da16738164 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:00.368992 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6ffb15d4-d84d-49a6-b8c6-f2da16738164 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:00.369439 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6ffb15d4-d84d-49a6-b8c6-f2da16738164 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:00.370130 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6ffb15d4-d84d-49a6-b8c6-f2da16738164 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:00.371218 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6ffb15d4-d84d-49a6-b8c6-f2da16738164 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:00.371649 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6ffb15d4-d84d-49a6-b8c6-f2da16738164 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:00.516319 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-6ffb15d4-d84d-49a6-b8c6-f2da16738164 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:00.523729 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-6ffb15d4-d84d-49a6-b8c6-f2da16738164 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1547 microversion: 2.1 time: 0.166224 Aug 17 23:46:00.524401 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 213/423] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:00 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1547 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:00.545029 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ebb47850-ec83-4057-8675-a29018d35989 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:00.545527 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ebb47850-ec83-4057-8675-a29018d35989 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:00.547524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:46:00.548419 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=12 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:46:00.554382 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ebb47850-ec83-4057-8675-a29018d35989 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:00.555087 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ebb47850-ec83-4057-8675-a29018d35989 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:00.555515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ebb47850-ec83-4057-8675-a29018d35989 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:00.556244 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ebb47850-ec83-4057-8675-a29018d35989 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:00.556702 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ebb47850-ec83-4057-8675-a29018d35989 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:00.557127 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ebb47850-ec83-4057-8675-a29018d35989 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:00.635282 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ebb47850-ec83-4057-8675-a29018d35989 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094721 Aug 17 23:46:00.636056 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 211/424] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Aug 17 23:46:00 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:46:00.817189 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-80213647-2328-4375-9276-b86ff7cce9e0 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:00.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-80213647-2328-4375-9276-b86ff7cce9e0 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:00.831849 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=8 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:46:00.850315 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-80213647-2328-4375-9276-b86ff7cce9e0 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:00.851525 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-80213647-2328-4375-9276-b86ff7cce9e0 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:00.854424 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-80213647-2328-4375-9276-b86ff7cce9e0 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:00.855810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-80213647-2328-4375-9276-b86ff7cce9e0 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:00.857222 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-80213647-2328-4375-9276-b86ff7cce9e0 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:00.858023 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-80213647-2328-4375-9276-b86ff7cce9e0 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:01.101736 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3255f73f-0b4b-48c6-8403-23f2180510bb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:01.102955 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3255f73f-0b4b-48c6-8403-23f2180510bb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:01.109723 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3255f73f-0b4b-48c6-8403-23f2180510bb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:01.110369 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3255f73f-0b4b-48c6-8403-23f2180510bb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:01.110909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3255f73f-0b4b-48c6-8403-23f2180510bb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:01.111704 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3255f73f-0b4b-48c6-8403-23f2180510bb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:01.112959 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3255f73f-0b4b-48c6-8403-23f2180510bb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:01.113211 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3255f73f-0b4b-48c6-8403-23f2180510bb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:01.176883 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-80213647-2328-4375-9276-b86ff7cce9e0 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:01.199986 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-80213647-2328-4375-9276-b86ff7cce9e0 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1314 microversion: 2.1 time: 0.386775 Aug 17 23:46:01.199986 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 214/425] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:00 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:01.291045 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3255f73f-0b4b-48c6-8403-23f2180510bb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:01.300035 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3255f73f-0b4b-48c6-8403-23f2180510bb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1510 microversion: 2.1 time: 0.201814 Aug 17 23:46:01.300786 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 212/426] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:01 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1510 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:02.187301 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-fea899aa-2ff8-4be1-b137-7a960b65a9bd req-d6c98632-3719-467b-b1c5-52f4117d2e94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16b92554-3f2a-482c-bcf5-1f5f05631227", "tag": "c9a2d576-b43b-452b-bd44-887c08463ddb"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:46:02.197570 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-fea899aa-2ff8-4be1-b137-7a960b65a9bd req-d6c98632-3719-467b-b1c5-52f4117d2e94 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:02.198443 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-fea899aa-2ff8-4be1-b137-7a960b65a9bd req-d6c98632-3719-467b-b1c5-52f4117d2e94 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:02.199042 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-fea899aa-2ff8-4be1-b137-7a960b65a9bd req-d6c98632-3719-467b-b1c5-52f4117d2e94 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:02.211944 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-fea899aa-2ff8-4be1-b137-7a960b65a9bd req-d6c98632-3719-467b-b1c5-52f4117d2e94 service nova] Creating event network-changed:c9a2d576-b43b-452b-bd44-887c08463ddb for instance 16b92554-3f2a-482c-bcf5-1f5f05631227 on hv-cinder-82002 Aug 17 23:46:02.217613 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-fea899aa-2ff8-4be1-b137-7a960b65a9bd req-d6c98632-3719-467b-b1c5-52f4117d2e94 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034019 Aug 17 23:46:02.219041 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a9f7391a-baf5-4aae-9169-8af93a50f510 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:02.221429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a9f7391a-baf5-4aae-9169-8af93a50f510 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:02.221552 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 215/427] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:46:02.238759 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a9f7391a-baf5-4aae-9169-8af93a50f510 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:02.239387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a9f7391a-baf5-4aae-9169-8af93a50f510 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:02.240094 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a9f7391a-baf5-4aae-9169-8af93a50f510 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:02.240961 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a9f7391a-baf5-4aae-9169-8af93a50f510 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:02.241574 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a9f7391a-baf5-4aae-9169-8af93a50f510 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:02.245314 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a9f7391a-baf5-4aae-9169-8af93a50f510 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:02.324126 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-3de1652a-3cce-473b-9fd7-1bcecd2aa86c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:02.324823 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-3de1652a-3cce-473b-9fd7-1bcecd2aa86c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:02.332624 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3de1652a-3cce-473b-9fd7-1bcecd2aa86c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:02.333412 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3de1652a-3cce-473b-9fd7-1bcecd2aa86c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:02.334017 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3de1652a-3cce-473b-9fd7-1bcecd2aa86c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:02.334916 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3de1652a-3cce-473b-9fd7-1bcecd2aa86c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:02.335616 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3de1652a-3cce-473b-9fd7-1bcecd2aa86c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:02.336254 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3de1652a-3cce-473b-9fd7-1bcecd2aa86c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:02.436455 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a9f7391a-baf5-4aae-9169-8af93a50f510 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:02.446048 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a9f7391a-baf5-4aae-9169-8af93a50f510 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1314 microversion: 2.1 time: 0.235229 Aug 17 23:46:02.447385 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 213/428] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:02 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:02.495011 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-3de1652a-3cce-473b-9fd7-1bcecd2aa86c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:02.506842 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-3de1652a-3cce-473b-9fd7-1bcecd2aa86c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1510 microversion: 2.1 time: 0.187688 Aug 17 23:46:02.507670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 216/429] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:02 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:03.466962 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-d650c2ff-af39-432f-a273-c4bf2917d899 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:03.467724 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-d650c2ff-af39-432f-a273-c4bf2917d899 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:03.474633 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d650c2ff-af39-432f-a273-c4bf2917d899 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:03.475198 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d650c2ff-af39-432f-a273-c4bf2917d899 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:03.475641 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d650c2ff-af39-432f-a273-c4bf2917d899 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:03.476383 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d650c2ff-af39-432f-a273-c4bf2917d899 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:03.476839 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d650c2ff-af39-432f-a273-c4bf2917d899 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:03.477265 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d650c2ff-af39-432f-a273-c4bf2917d899 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:03.498623 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=100 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:46:03.530384 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-bb596a42-71a0-4d7f-9719-72d98ed9f633 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:03.531069 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-bb596a42-71a0-4d7f-9719-72d98ed9f633 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:03.537870 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb596a42-71a0-4d7f-9719-72d98ed9f633 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:03.538354 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb596a42-71a0-4d7f-9719-72d98ed9f633 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:03.538792 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb596a42-71a0-4d7f-9719-72d98ed9f633 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:03.539495 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb596a42-71a0-4d7f-9719-72d98ed9f633 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:03.539951 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb596a42-71a0-4d7f-9719-72d98ed9f633 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:03.540840 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb596a42-71a0-4d7f-9719-72d98ed9f633 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:03.628187 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d650c2ff-af39-432f-a273-c4bf2917d899 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:03.636008 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-d650c2ff-af39-432f-a273-c4bf2917d899 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1314 microversion: 2.1 time: 0.172840 Aug 17 23:46:03.637074 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 214/430] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:03 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:03.683931 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-bb596a42-71a0-4d7f-9719-72d98ed9f633 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:03.691394 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-bb596a42-71a0-4d7f-9719-72d98ed9f633 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1510 microversion: 2.1 time: 0.165825 Aug 17 23:46:03.691980 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 217/431] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:03 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:04.657248 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e0381e05-a39f-4bcd-87b5-53f4fbf55d2a tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:04.657861 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e0381e05-a39f-4bcd-87b5-53f4fbf55d2a tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:04.663939 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e0381e05-a39f-4bcd-87b5-53f4fbf55d2a tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:04.664559 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e0381e05-a39f-4bcd-87b5-53f4fbf55d2a tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:04.664993 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e0381e05-a39f-4bcd-87b5-53f4fbf55d2a tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:04.665677 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e0381e05-a39f-4bcd-87b5-53f4fbf55d2a tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:04.666130 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e0381e05-a39f-4bcd-87b5-53f4fbf55d2a tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:04.666576 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e0381e05-a39f-4bcd-87b5-53f4fbf55d2a tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:04.712827 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c653a7f2-06c0-489c-b908-11ed7556ecba tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:04.713448 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c653a7f2-06c0-489c-b908-11ed7556ecba tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:04.720453 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c653a7f2-06c0-489c-b908-11ed7556ecba tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:04.720942 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c653a7f2-06c0-489c-b908-11ed7556ecba tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:04.721387 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c653a7f2-06c0-489c-b908-11ed7556ecba tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:04.722085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c653a7f2-06c0-489c-b908-11ed7556ecba tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:04.722543 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c653a7f2-06c0-489c-b908-11ed7556ecba tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:04.722971 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c653a7f2-06c0-489c-b908-11ed7556ecba tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:04.799380 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e0381e05-a39f-4bcd-87b5-53f4fbf55d2a tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:04.806969 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e0381e05-a39f-4bcd-87b5-53f4fbf55d2a tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1314 microversion: 2.1 time: 0.153524 Aug 17 23:46:04.807524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 215/432] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:04 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:04.853664 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c653a7f2-06c0-489c-b908-11ed7556ecba tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:04.861084 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c653a7f2-06c0-489c-b908-11ed7556ecba tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1510 microversion: 2.1 time: 0.152504 Aug 17 23:46:04.861633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 218/433] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:04 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:05.826511 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-84ab53d2-e5d2-444f-9b72-a36616b6a90c tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:05.827628 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-84ab53d2-e5d2-444f-9b72-a36616b6a90c tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:05.834050 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-84ab53d2-e5d2-444f-9b72-a36616b6a90c tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:05.834543 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-84ab53d2-e5d2-444f-9b72-a36616b6a90c tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:05.834982 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-84ab53d2-e5d2-444f-9b72-a36616b6a90c tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:05.835687 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-84ab53d2-e5d2-444f-9b72-a36616b6a90c tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:05.836171 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-84ab53d2-e5d2-444f-9b72-a36616b6a90c tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:05.836775 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-84ab53d2-e5d2-444f-9b72-a36616b6a90c tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:05.882133 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-11b4f207-9f36-4055-a143-806777eb46f1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:05.882900 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-11b4f207-9f36-4055-a143-806777eb46f1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:05.889287 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-11b4f207-9f36-4055-a143-806777eb46f1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:05.889779 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-11b4f207-9f36-4055-a143-806777eb46f1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:05.890220 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-11b4f207-9f36-4055-a143-806777eb46f1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:05.890915 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-11b4f207-9f36-4055-a143-806777eb46f1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:05.891542 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-11b4f207-9f36-4055-a143-806777eb46f1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:05.891993 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-11b4f207-9f36-4055-a143-806777eb46f1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:06.049804 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-11b4f207-9f36-4055-a143-806777eb46f1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:06.054020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:46:06.060259 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-11b4f207-9f36-4055-a143-806777eb46f1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1510 microversion: 2.1 time: 0.181910 Aug 17 23:46:06.061285 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 219/434] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:05 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:06.140854 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-84ab53d2-e5d2-444f-9b72-a36616b6a90c tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:06.149005 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-84ab53d2-e5d2-444f-9b72-a36616b6a90c tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1314 microversion: 2.1 time: 0.326239 Aug 17 23:46:06.149910 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 216/435] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:05 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:07.084283 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-aa79e7c6-480f-48c9-8b98-307ef432c616 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:07.084940 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-aa79e7c6-480f-48c9-8b98-307ef432c616 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:07.093355 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aa79e7c6-480f-48c9-8b98-307ef432c616 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:07.093849 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aa79e7c6-480f-48c9-8b98-307ef432c616 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:07.094301 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aa79e7c6-480f-48c9-8b98-307ef432c616 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:07.095003 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aa79e7c6-480f-48c9-8b98-307ef432c616 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:07.095465 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aa79e7c6-480f-48c9-8b98-307ef432c616 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:07.095891 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aa79e7c6-480f-48c9-8b98-307ef432c616 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:07.172866 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-24379947-0317-426e-84cf-65d756630b80 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:07.173503 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-24379947-0317-426e-84cf-65d756630b80 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:07.181164 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-24379947-0317-426e-84cf-65d756630b80 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:07.181788 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-24379947-0317-426e-84cf-65d756630b80 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:07.182228 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-24379947-0317-426e-84cf-65d756630b80 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:07.183272 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-24379947-0317-426e-84cf-65d756630b80 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:07.184006 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-24379947-0317-426e-84cf-65d756630b80 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:07.184481 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-24379947-0317-426e-84cf-65d756630b80 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:07.234926 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-aa79e7c6-480f-48c9-8b98-307ef432c616 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:07.247633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-aa79e7c6-480f-48c9-8b98-307ef432c616 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1510 microversion: 2.1 time: 0.168671 Aug 17 23:46:07.260352 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 220/436] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:07 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:07.265861 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-d2ec3eb7-499c-4f22-aa62-f44b21f50b7f req-e1aef8d0-d8f3-4b4a-ab28-64d4e59a0303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc622bb-1f93-429a-b616-ebe52d601923", "name": "network-vif-plugged", "status": "completed", "tag": "fc183e87-2a03-4fa2-b930-971be7b21603"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:46:07.277308 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-d2ec3eb7-499c-4f22-aa62-f44b21f50b7f req-e1aef8d0-d8f3-4b4a-ab28-64d4e59a0303 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:07.277794 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-d2ec3eb7-499c-4f22-aa62-f44b21f50b7f req-e1aef8d0-d8f3-4b4a-ab28-64d4e59a0303 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:07.278219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-d2ec3eb7-499c-4f22-aa62-f44b21f50b7f req-e1aef8d0-d8f3-4b4a-ab28-64d4e59a0303 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:07.297592 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-d2ec3eb7-499c-4f22-aa62-f44b21f50b7f req-e1aef8d0-d8f3-4b4a-ab28-64d4e59a0303 service nova] Creating event network-vif-plugged:fc183e87-2a03-4fa2-b930-971be7b21603 for instance 2cc622bb-1f93-429a-b616-ebe52d601923 on hv-cinder-82002 Aug 17 23:46:07.303612 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-d2ec3eb7-499c-4f22-aa62-f44b21f50b7f req-e1aef8d0-d8f3-4b4a-ab28-64d4e59a0303 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041948 Aug 17 23:46:07.304548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 221/437] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:46:07.346950 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-24379947-0317-426e-84cf-65d756630b80 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:07.354467 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-24379947-0317-426e-84cf-65d756630b80 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1314 microversion: 2.1 time: 0.185469 Aug 17 23:46:07.355721 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 217/438] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:07 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:46:08.272815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-fc102818-ecd2-4661-8c91-16dbb023b59e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:08.273519 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-fc102818-ecd2-4661-8c91-16dbb023b59e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:08.280131 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fc102818-ecd2-4661-8c91-16dbb023b59e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:08.280621 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fc102818-ecd2-4661-8c91-16dbb023b59e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:08.281064 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fc102818-ecd2-4661-8c91-16dbb023b59e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:08.281756 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fc102818-ecd2-4661-8c91-16dbb023b59e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:08.282218 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fc102818-ecd2-4661-8c91-16dbb023b59e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:08.282651 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fc102818-ecd2-4661-8c91-16dbb023b59e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:08.376199 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-773c6141-1997-4d52-9d05-d97c823a05ff tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:08.376915 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-773c6141-1997-4d52-9d05-d97c823a05ff tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:08.382898 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-773c6141-1997-4d52-9d05-d97c823a05ff tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:08.383603 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-773c6141-1997-4d52-9d05-d97c823a05ff tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:08.384850 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-773c6141-1997-4d52-9d05-d97c823a05ff tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:08.385623 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-773c6141-1997-4d52-9d05-d97c823a05ff tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:08.386092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-773c6141-1997-4d52-9d05-d97c823a05ff tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:08.386516 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-773c6141-1997-4d52-9d05-d97c823a05ff tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:08.411938 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-fc102818-ecd2-4661-8c91-16dbb023b59e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:08.420342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-fc102818-ecd2-4661-8c91-16dbb023b59e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1510 microversion: 2.1 time: 0.151651 Aug 17 23:46:08.420918 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 222/439] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:08 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:08.515735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-773c6141-1997-4d52-9d05-d97c823a05ff tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:08.523155 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-773c6141-1997-4d52-9d05-d97c823a05ff tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1314 microversion: 2.1 time: 0.150777 Aug 17 23:46:08.523658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 218/440] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:08 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:46:09.442115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-21686cd8-2236-4a32-9389-18471e9b9599 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:09.442655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-21686cd8-2236-4a32-9389-18471e9b9599 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:09.449978 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-21686cd8-2236-4a32-9389-18471e9b9599 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:09.450469 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-21686cd8-2236-4a32-9389-18471e9b9599 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:09.450905 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-21686cd8-2236-4a32-9389-18471e9b9599 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:09.451598 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-21686cd8-2236-4a32-9389-18471e9b9599 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:09.452083 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-21686cd8-2236-4a32-9389-18471e9b9599 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:09.452538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-21686cd8-2236-4a32-9389-18471e9b9599 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:09.543186 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2770d295-a927-4673-bffd-79eeabfbcb30 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:09.544053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2770d295-a927-4673-bffd-79eeabfbcb30 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:09.550518 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2770d295-a927-4673-bffd-79eeabfbcb30 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:09.551014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2770d295-a927-4673-bffd-79eeabfbcb30 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:09.551461 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2770d295-a927-4673-bffd-79eeabfbcb30 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:09.552209 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2770d295-a927-4673-bffd-79eeabfbcb30 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:09.552672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2770d295-a927-4673-bffd-79eeabfbcb30 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:09.553101 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2770d295-a927-4673-bffd-79eeabfbcb30 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:09.590743 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-21686cd8-2236-4a32-9389-18471e9b9599 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:09.598445 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-21686cd8-2236-4a32-9389-18471e9b9599 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1510 microversion: 2.1 time: 0.160165 Aug 17 23:46:09.599016 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 223/441] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:09 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:09.683220 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2770d295-a927-4673-bffd-79eeabfbcb30 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:09.690778 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2770d295-a927-4673-bffd-79eeabfbcb30 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1314 microversion: 2.1 time: 0.151397 Aug 17 23:46:09.691372 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 219/442] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:09 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:46:10.618602 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-87223aee-689e-45f3-8066-1b052716da33 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:10.619251 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-87223aee-689e-45f3-8066-1b052716da33 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:10.625820 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87223aee-689e-45f3-8066-1b052716da33 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:10.626250 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87223aee-689e-45f3-8066-1b052716da33 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:10.626690 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87223aee-689e-45f3-8066-1b052716da33 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:10.627385 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87223aee-689e-45f3-8066-1b052716da33 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:10.627842 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87223aee-689e-45f3-8066-1b052716da33 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:10.628296 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87223aee-689e-45f3-8066-1b052716da33 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:10.712371 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-eb0e4a12-f32b-412e-96a4-ed2ae24de669 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:10.713212 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-eb0e4a12-f32b-412e-96a4-ed2ae24de669 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:10.720215 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eb0e4a12-f32b-412e-96a4-ed2ae24de669 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:10.720712 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eb0e4a12-f32b-412e-96a4-ed2ae24de669 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:10.721316 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eb0e4a12-f32b-412e-96a4-ed2ae24de669 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:10.722175 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eb0e4a12-f32b-412e-96a4-ed2ae24de669 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:10.722917 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eb0e4a12-f32b-412e-96a4-ed2ae24de669 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:10.723555 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eb0e4a12-f32b-412e-96a4-ed2ae24de669 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:10.777420 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-87223aee-689e-45f3-8066-1b052716da33 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:10.785413 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-87223aee-689e-45f3-8066-1b052716da33 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1516 microversion: 2.1 time: 0.170465 Aug 17 23:46:10.786183 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 224/443] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:10 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:10.885524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-eb0e4a12-f32b-412e-96a4-ed2ae24de669 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:10.894715 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-eb0e4a12-f32b-412e-96a4-ed2ae24de669 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1314 microversion: 2.1 time: 0.186171 Aug 17 23:46:10.895671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 220/444] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:10 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:11.916747 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ee93eb67-abf6-4a64-9c55-5620bd843eed tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:11.917373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ee93eb67-abf6-4a64-9c55-5620bd843eed tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:11.923913 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ee93eb67-abf6-4a64-9c55-5620bd843eed tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:11.924475 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ee93eb67-abf6-4a64-9c55-5620bd843eed tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:11.924929 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ee93eb67-abf6-4a64-9c55-5620bd843eed tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:11.925630 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ee93eb67-abf6-4a64-9c55-5620bd843eed tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:11.926091 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ee93eb67-abf6-4a64-9c55-5620bd843eed tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:11.926524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ee93eb67-abf6-4a64-9c55-5620bd843eed tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:12.059377 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ee93eb67-abf6-4a64-9c55-5620bd843eed tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:12.067783 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ee93eb67-abf6-4a64-9c55-5620bd843eed tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1314 microversion: 2.1 time: 0.154789 Aug 17 23:46:12.068472 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 225/445] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:11 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:13.088171 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3b302f45-3f11-4d73-b782-10b38764b0e8 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:13.088900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3b302f45-3f11-4d73-b782-10b38764b0e8 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:13.090899 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:46:13.096402 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b302f45-3f11-4d73-b782-10b38764b0e8 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:13.096967 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b302f45-3f11-4d73-b782-10b38764b0e8 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:13.097699 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b302f45-3f11-4d73-b782-10b38764b0e8 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:13.098434 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b302f45-3f11-4d73-b782-10b38764b0e8 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:13.099119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b302f45-3f11-4d73-b782-10b38764b0e8 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:13.099526 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b302f45-3f11-4d73-b782-10b38764b0e8 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:13.248716 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3b302f45-3f11-4d73-b782-10b38764b0e8 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:13.257881 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3b302f45-3f11-4d73-b782-10b38764b0e8 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1314 microversion: 2.1 time: 0.173741 Aug 17 23:46:13.258594 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 221/446] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:13 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:14.278934 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f52e8f19-9bd5-46af-bb25-b24aa446b576 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:14.279556 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f52e8f19-9bd5-46af-bb25-b24aa446b576 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:14.287783 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f52e8f19-9bd5-46af-bb25-b24aa446b576 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:14.288354 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f52e8f19-9bd5-46af-bb25-b24aa446b576 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:14.289128 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f52e8f19-9bd5-46af-bb25-b24aa446b576 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:14.289850 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f52e8f19-9bd5-46af-bb25-b24aa446b576 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:14.290336 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f52e8f19-9bd5-46af-bb25-b24aa446b576 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:14.290792 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f52e8f19-9bd5-46af-bb25-b24aa446b576 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:14.579771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f52e8f19-9bd5-46af-bb25-b24aa446b576 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:14.587288 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f52e8f19-9bd5-46af-bb25-b24aa446b576 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1314 microversion: 2.1 time: 0.312520 Aug 17 23:46:14.587804 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 226/447] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:14 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:15.608601 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9f14a6ed-d84f-4709-bc24-afc2d4d0e176 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:15.609931 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9f14a6ed-d84f-4709-bc24-afc2d4d0e176 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:15.616095 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9f14a6ed-d84f-4709-bc24-afc2d4d0e176 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:15.616840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9f14a6ed-d84f-4709-bc24-afc2d4d0e176 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:15.617482 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9f14a6ed-d84f-4709-bc24-afc2d4d0e176 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:15.618477 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9f14a6ed-d84f-4709-bc24-afc2d4d0e176 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:15.619126 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9f14a6ed-d84f-4709-bc24-afc2d4d0e176 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:15.619753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9f14a6ed-d84f-4709-bc24-afc2d4d0e176 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:15.782254 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9f14a6ed-d84f-4709-bc24-afc2d4d0e176 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:15.790694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9f14a6ed-d84f-4709-bc24-afc2d4d0e176 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1314 microversion: 2.1 time: 0.186353 Aug 17 23:46:15.791523 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 222/448] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:15 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:16.413742 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-660e0e18-06b6-44f9-9e46-26bd00695d1e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Action: 'create', calling method: .version_select at 0x7f85fda821f0>, body: {"keypair": {"name": "tempest-keypair-813049522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAVRRBoQJbuAzP6KydlZG9xnBq0RfORX0H+94CUw7gO+qKAnqSIVcmh6xfVtbIcdlnoaLjdaCkkA0z9jVrUOfmKZkvYQuZKP/39CZx270wutsxBXhPFACy3igoX3dLxAg=="}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:46:16.430730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-660e0e18-06b6-44f9-9e46-26bd00695d1e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Getting quotas for project dbc0fe79b67f4446b1a4c36c068f9b00. Resources: {'key_pairs'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:46:16.435263 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-660e0e18-06b6-44f9-9e46-26bd00695d1e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Getting quotas for user c67dec924b7e4f0aa0874e6e21879889 and project dbc0fe79b67f4446b1a4c36c068f9b00. Resources: {'key_pairs'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:46:16.469397 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-660e0e18-06b6-44f9-9e46-26bd00695d1e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059643 Aug 17 23:46:16.470148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 227/449] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Aug 17 23:46:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:46:16.814576 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-489c2617-483b-4c84-8817-75727007a078 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:16.815714 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-489c2617-483b-4c84-8817-75727007a078 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:16.827187 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-489c2617-483b-4c84-8817-75727007a078 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:16.827707 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-489c2617-483b-4c84-8817-75727007a078 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:16.828201 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-489c2617-483b-4c84-8817-75727007a078 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:16.828933 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-489c2617-483b-4c84-8817-75727007a078 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:16.829404 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-489c2617-483b-4c84-8817-75727007a078 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:16.829834 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-489c2617-483b-4c84-8817-75727007a078 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:17.088063 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-489c2617-483b-4c84-8817-75727007a078 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:17.097301 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-489c2617-483b-4c84-8817-75727007a078 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1463 microversion: 2.1 time: 0.286937 Aug 17 23:46:17.113636 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 223/450] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:16 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1463 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:17.147021 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a781f7e6-db28-4c79-be4a-33e515468723 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:17.147589 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a781f7e6-db28-4c79-be4a-33e515468723 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:17.154206 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a781f7e6-db28-4c79-be4a-33e515468723 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:17.155038 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a781f7e6-db28-4c79-be4a-33e515468723 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:17.155544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a781f7e6-db28-4c79-be4a-33e515468723 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:17.156389 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a781f7e6-db28-4c79-be4a-33e515468723 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:17.157064 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a781f7e6-db28-4c79-be4a-33e515468723 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:17.157727 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a781f7e6-db28-4c79-be4a-33e515468723 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:17.186848 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a781f7e6-db28-4c79-be4a-33e515468723 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Going to try to terminate instance {{(pid=131394) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:46:17.337136 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a781f7e6-db28-4c79-be4a-33e515468723 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 204 len: 0 microversion: 2.1 time: 0.190282 Aug 17 23:46:17.338263 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 228/451] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:46:17 2022] DELETE /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 23:46:17.347640 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-7f11b948-f9af-4964-a616-faaad233012b tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:17.348670 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-7f11b948-f9af-4964-a616-faaad233012b tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:17.355185 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7f11b948-f9af-4964-a616-faaad233012b tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:17.355675 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7f11b948-f9af-4964-a616-faaad233012b tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:17.356357 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7f11b948-f9af-4964-a616-faaad233012b tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:17.357061 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7f11b948-f9af-4964-a616-faaad233012b tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:17.357691 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7f11b948-f9af-4964-a616-faaad233012b tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:17.358118 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7f11b948-f9af-4964-a616-faaad233012b tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:17.602538 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7f11b948-f9af-4964-a616-faaad233012b tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:17.610989 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-7f11b948-f9af-4964-a616-faaad233012b tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1469 microversion: 2.1 time: 0.267742 Aug 17 23:46:17.623591 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 224/452] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:17 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1469 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:18.397346 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-98321fbf-199f-4a5a-b217-13234afbaf96 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1803167569", "imageRef": "a3cf81e5-e973-4c08-b1da-4e8f104b52a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "118a36b6-d40e-41df-9c07-5e59fcb025b9"}], "security_groups": [{"name": "tempest-securitygroup--749578134"}], "key_name": "tempest-keypair-813049522", "user_data": "}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:46:18.519238 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.network.neutron [None req-98321fbf-199f-4a5a-b217-13234afbaf96 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] validate_networks() for [('118a36b6-d40e-41df-9c07-5e59fcb025b9', None, None, None, None, None)] {{(pid=131394) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:46:18.637156 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-4bfbc690-a0d0-440f-9520-1f6253099347 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:18.637776 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-4bfbc690-a0d0-440f-9520-1f6253099347 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:18.646781 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4bfbc690-a0d0-440f-9520-1f6253099347 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:18.647176 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4bfbc690-a0d0-440f-9520-1f6253099347 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:18.647785 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4bfbc690-a0d0-440f-9520-1f6253099347 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:18.648787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4bfbc690-a0d0-440f-9520-1f6253099347 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:18.649406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4bfbc690-a0d0-440f-9520-1f6253099347 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:18.650854 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4bfbc690-a0d0-440f-9520-1f6253099347 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:18.847521 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-4bfbc690-a0d0-440f-9520-1f6253099347 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:18.855601 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-4bfbc690-a0d0-440f-9520-1f6253099347 tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1469 microversion: 2.1 time: 0.222420 Aug 17 23:46:18.856368 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 225/453] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:18 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1469 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:19.526819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-98321fbf-199f-4a5a-b217-13234afbaf96 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Flavor limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:46:19.527260 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-98321fbf-199f-4a5a-b217-13234afbaf96 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Image limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:46:19.527769 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-98321fbf-199f-4a5a-b217-13234afbaf96 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Flavor pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:46:19.528248 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-98321fbf-199f-4a5a-b217-13234afbaf96 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Image pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:46:19.528747 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-98321fbf-199f-4a5a-b217-13234afbaf96 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:46:19.544738 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-98321fbf-199f-4a5a-b217-13234afbaf96 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:19.546256 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-98321fbf-199f-4a5a-b217-13234afbaf96 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:19.547217 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-98321fbf-199f-4a5a-b217-13234afbaf96 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:19.549921 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-98321fbf-199f-4a5a-b217-13234afbaf96 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:19.551884 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-98321fbf-199f-4a5a-b217-13234afbaf96 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:19.554869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-98321fbf-199f-4a5a-b217-13234afbaf96 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:19.585877 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-98321fbf-199f-4a5a-b217-13234afbaf96 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Getting quotas for project dbc0fe79b67f4446b1a4c36c068f9b00. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:46:19.595156 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-98321fbf-199f-4a5a-b217-13234afbaf96 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Getting quotas for user c67dec924b7e4f0aa0874e6e21879889 and project dbc0fe79b67f4446b1a4c36c068f9b00. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:46:19.609360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-98321fbf-199f-4a5a-b217-13234afbaf96 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Going to run 1 instances... {{(pid=131394) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:46:19.615086 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-98321fbf-199f-4a5a-b217-13234afbaf96 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a3cf81e5-e973-4c08-b1da-4e8f104b52a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131394) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:46:19.686757 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-98321fbf-199f-4a5a-b217-13234afbaf96 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.295198 Aug 17 23:46:19.696932 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 229/454] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 17 23:46:18 2022] POST /compute/v2.1/servers => generated 408 bytes in 1306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 23:46:19.706381 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2c56165e-b8dd-4054-8cbb-9e5e0fb6e6f6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:19.707534 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2c56165e-b8dd-4054-8cbb-9e5e0fb6e6f6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:19.834021 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2c56165e-b8dd-4054-8cbb-9e5e0fb6e6f6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:19.843386 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2c56165e-b8dd-4054-8cbb-9e5e0fb6e6f6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1245 microversion: 2.1 time: 0.146301 Aug 17 23:46:19.846314 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 226/455] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:19 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1245 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:19.879096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1cf320fc-cf14-4f55-b47a-93ecd0bf4e3d tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:19.879717 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1cf320fc-cf14-4f55-b47a-93ecd0bf4e3d tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:19.905359 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1cf320fc-cf14-4f55-b47a-93ecd0bf4e3d tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:19.905859 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1cf320fc-cf14-4f55-b47a-93ecd0bf4e3d tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:19.906299 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1cf320fc-cf14-4f55-b47a-93ecd0bf4e3d tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:19.907001 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1cf320fc-cf14-4f55-b47a-93ecd0bf4e3d tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:19.907459 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1cf320fc-cf14-4f55-b47a-93ecd0bf4e3d tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:19.907880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1cf320fc-cf14-4f55-b47a-93ecd0bf4e3d tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:20.213345 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-500f8a40-1cfa-4d2b-b24b-a6470e68ff61 req-bcf0234e-575a-4c1a-9600-01f86432c36d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc622bb-1f93-429a-b616-ebe52d601923", "name": "network-vif-deleted", "tag": "fc183e87-2a03-4fa2-b930-971be7b21603"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:46:20.229356 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-500f8a40-1cfa-4d2b-b24b-a6470e68ff61 req-bcf0234e-575a-4c1a-9600-01f86432c36d service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:20.232810 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-500f8a40-1cfa-4d2b-b24b-a6470e68ff61 req-bcf0234e-575a-4c1a-9600-01f86432c36d service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:20.233454 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-500f8a40-1cfa-4d2b-b24b-a6470e68ff61 req-bcf0234e-575a-4c1a-9600-01f86432c36d service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:20.259287 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1cf320fc-cf14-4f55-b47a-93ecd0bf4e3d tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34ca182eb1c4627beb18ac1256607f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f504189f5a949cdae85a009e3b182b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:20.265367 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-500f8a40-1cfa-4d2b-b24b-a6470e68ff61 req-bcf0234e-575a-4c1a-9600-01f86432c36d service nova] Creating event network-vif-deleted:fc183e87-2a03-4fa2-b930-971be7b21603 for instance 2cc622bb-1f93-429a-b616-ebe52d601923 on hv-cinder-82002 Aug 17 23:46:20.272991 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1cf320fc-cf14-4f55-b47a-93ecd0bf4e3d tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 200 len: 1469 microversion: 2.1 time: 0.399812 Aug 17 23:46:20.273574 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 230/456] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:19 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 1469 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:20.277712 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-500f8a40-1cfa-4d2b-b24b-a6470e68ff61 req-bcf0234e-575a-4c1a-9600-01f86432c36d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068185 Aug 17 23:46:20.278274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 227/457] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:46:20.865752 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-4e51968f-a174-4ecd-b242-0d9d39acaaf6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:20.866376 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-4e51968f-a174-4ecd-b242-0d9d39acaaf6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:20.878258 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:46:20.881669 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4e51968f-a174-4ecd-b242-0d9d39acaaf6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:20.882432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4e51968f-a174-4ecd-b242-0d9d39acaaf6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:20.883235 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4e51968f-a174-4ecd-b242-0d9d39acaaf6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:20.885002 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4e51968f-a174-4ecd-b242-0d9d39acaaf6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:20.888113 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4e51968f-a174-4ecd-b242-0d9d39acaaf6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:20.889059 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4e51968f-a174-4ecd-b242-0d9d39acaaf6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:20.983587 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-4e51968f-a174-4ecd-b242-0d9d39acaaf6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:20.998895 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-4e51968f-a174-4ecd-b242-0d9d39acaaf6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1249 microversion: 2.1 time: 0.137174 Aug 17 23:46:20.999477 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 231/458] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:20 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1249 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:21.297775 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0f715ac6-ddd5-40cd-9d1c-2d799fb1c7fd tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:21.298512 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0f715ac6-ddd5-40cd-9d1c-2d799fb1c7fd tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] [instance: 2cc622bb-1f93-429a-b616-ebe52d601923] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:21.311197 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0f715ac6-ddd5-40cd-9d1c-2d799fb1c7fd tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:21.314273 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0f715ac6-ddd5-40cd-9d1c-2d799fb1c7fd tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:21.314951 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0f715ac6-ddd5-40cd-9d1c-2d799fb1c7fd tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:21.315930 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0f715ac6-ddd5-40cd-9d1c-2d799fb1c7fd tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:21.316673 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0f715ac6-ddd5-40cd-9d1c-2d799fb1c7fd tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:21.319294 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0f715ac6-ddd5-40cd-9d1c-2d799fb1c7fd tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:21.373873 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-0f715ac6-ddd5-40cd-9d1c-2d799fb1c7fd tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] HTTP exception thrown: Instance 2cc622bb-1f93-429a-b616-ebe52d601923 could not be found. Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0f715ac6-ddd5-40cd-9d1c-2d799fb1c7fd tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Request method failure captured: Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 HTTP/1.1 Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X2rVOIrqVzAJnIGSJfUdT4LPd1Vz46Dwq1LUgfUatSsCTFEZkvwdQSVC6l-RkI5x1VdKRD6moO9rJfXhBptbB3pHae4wBTqh04LrJBzGvrc31NJu62ksUtmyFgxqMqcIcA_CAQ5WndYVwxR1L3DcjgUrqydXHNUGevOkbHQTNSCZ9E Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: 9f504189f5a949cdae85a009e3b182b1 Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-VolumesNegativeTest-1406015440 Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:46:21.379735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:46:21.381524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9f504189f5a949cdae85a009e3b182b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9f504189f5a949cdae85a009e3b182b1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f504189f5a949cdae85a009e3b182b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f504189f5a949cdae85a009e3b182b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:46:21.381524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-VolumesNegativeTest-1406015440 Aug 17 23:46:21.381524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: 9f504189f5a949cdae85a009e3b182b1 Aug 17 23:46:21.381524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-VolumesNegativeTest-1406015440 Aug 17 23:46:21.381524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-VolumesNegativeTest-1406015440-project Aug 17 23:46:21.381524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:46:21.381524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:46:21.381524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: f34ca182eb1c4627beb18ac1256607f8 Aug 17 23:46:21.381524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-VolumesNegativeTest-1406015440-project Aug 17 23:46:21.381524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:46:21.381524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance 2cc622bb-1f93-429a-b616-ebe52d601923 could not be found. Aug 17 23:46:21.381524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': '2cc622bb-1f93-429a-b616-ebe52d601923'} Aug 17 23:46:21.382537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:46:21.382537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:46:21.382537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:46:21.382537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:46:21.382537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:46:21.382537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:46:21.382537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:46:21.382537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:46:21.382537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:46:21.382537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:46:21.382537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cc622bb-1f93-429a-b616-ebe52d601923 could not be found. Aug 17 23:46:21.382537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:46:21.382537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:46:21.382537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:46:21.382537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:46:21.382537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:46:21.382537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:46:21.382537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:46:21.382537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:46:21.382537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:46:21.384100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:46:21.384100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:46:21.384100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:46:21.384100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:46:21.384100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:46:21.384100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:46:21.384100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:46:21.384100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cc622bb-1f93-429a-b616-ebe52d601923 could not be found. Aug 17 23:46:21.384100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:46:21.384100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:46:21.384100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:46:21.384100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:46:21.384100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:46:21.384100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:46:21.384100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:46:21.384100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:46:21.384100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cc622bb-1f93-429a-b616-ebe52d601923 could not be found. Aug 17 23:46:21.384100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:46:21.386602 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0f715ac6-ddd5-40cd-9d1c-2d799fb1c7fd tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] Returning 404 to user: Instance 2cc622bb-1f93-429a-b616-ebe52d601923 could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:46:21.388224 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0f715ac6-ddd5-40cd-9d1c-2d799fb1c7fd tempest-VolumesNegativeTest-1406015440 tempest-VolumesNegativeTest-1406015440-project] 10.222.0.26 "GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923" status: 404 len: 111 microversion: 2.1 time: 0.094784 Aug 17 23:46:21.389385 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 228/459] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:21 2022] GET /compute/v2.1/servers/2cc622bb-1f93-429a-b616-ebe52d601923 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:46:22.021472 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f968551c-4d91-4994-9501-2b9f16b2fbcb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:22.022095 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f968551c-4d91-4994-9501-2b9f16b2fbcb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:22.042717 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f968551c-4d91-4994-9501-2b9f16b2fbcb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:22.047654 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f968551c-4d91-4994-9501-2b9f16b2fbcb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:22.048375 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f968551c-4d91-4994-9501-2b9f16b2fbcb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:22.051334 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f968551c-4d91-4994-9501-2b9f16b2fbcb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:22.055490 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f968551c-4d91-4994-9501-2b9f16b2fbcb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:22.056653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f968551c-4d91-4994-9501-2b9f16b2fbcb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:22.211903 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f968551c-4d91-4994-9501-2b9f16b2fbcb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:22.225332 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f968551c-4d91-4994-9501-2b9f16b2fbcb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1305 microversion: 2.1 time: 0.205806 Aug 17 23:46:22.226940 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 232/460] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:22 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1305 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:23.250471 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-90f39ee7-d96d-4071-a484-f01ac3b3de7f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:23.252406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-90f39ee7-d96d-4071-a484-f01ac3b3de7f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:23.264167 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90f39ee7-d96d-4071-a484-f01ac3b3de7f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:23.264674 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90f39ee7-d96d-4071-a484-f01ac3b3de7f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:23.266784 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90f39ee7-d96d-4071-a484-f01ac3b3de7f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:23.267523 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90f39ee7-d96d-4071-a484-f01ac3b3de7f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:23.268002 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90f39ee7-d96d-4071-a484-f01ac3b3de7f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:23.270240 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90f39ee7-d96d-4071-a484-f01ac3b3de7f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:23.399751 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-90f39ee7-d96d-4071-a484-f01ac3b3de7f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:23.419575 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-90f39ee7-d96d-4071-a484-f01ac3b3de7f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1303 microversion: 2.1 time: 0.170778 Aug 17 23:46:23.421560 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 229/461] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:23 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1303 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:24.481625 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-3948dcd9-6fc0-4719-a827-fcc3f0bc0496 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:24.481625 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-3948dcd9-6fc0-4719-a827-fcc3f0bc0496 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:24.496280 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3948dcd9-6fc0-4719-a827-fcc3f0bc0496 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:24.502481 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3948dcd9-6fc0-4719-a827-fcc3f0bc0496 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:24.503729 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3948dcd9-6fc0-4719-a827-fcc3f0bc0496 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:24.505029 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3948dcd9-6fc0-4719-a827-fcc3f0bc0496 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:24.505678 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3948dcd9-6fc0-4719-a827-fcc3f0bc0496 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:24.506247 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3948dcd9-6fc0-4719-a827-fcc3f0bc0496 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:24.716766 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-3948dcd9-6fc0-4719-a827-fcc3f0bc0496 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:24.728667 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-3948dcd9-6fc0-4719-a827-fcc3f0bc0496 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1370 microversion: 2.1 time: 0.290615 Aug 17 23:46:24.729287 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 233/462] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:24 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1370 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:25.732293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-21b8a370-e566-4dd2-8d9e-797955903da7 req-97b374db-96bb-47ae-9285-1647575b1adb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b73d6d-ce40-4adb-bbd2-7ac326eb758a", "tag": "a7bb89fa-fcc0-415d-8ac1-70d1ad224517"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:46:25.766186 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-21b8a370-e566-4dd2-8d9e-797955903da7 req-97b374db-96bb-47ae-9285-1647575b1adb service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:25.769307 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-21b8a370-e566-4dd2-8d9e-797955903da7 req-97b374db-96bb-47ae-9285-1647575b1adb service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:25.770626 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-21b8a370-e566-4dd2-8d9e-797955903da7 req-97b374db-96bb-47ae-9285-1647575b1adb service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:25.799095 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-21b8a370-e566-4dd2-8d9e-797955903da7 req-97b374db-96bb-47ae-9285-1647575b1adb service nova] Creating event network-changed:a7bb89fa-fcc0-415d-8ac1-70d1ad224517 for instance 20b73d6d-ce40-4adb-bbd2-7ac326eb758a on hv-cinder-82002 Aug 17 23:46:25.810561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-21b8a370-e566-4dd2-8d9e-797955903da7 req-97b374db-96bb-47ae-9285-1647575b1adb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082312 Aug 17 23:46:25.811287 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 234/463] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:46:25.819992 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d77826b8-a707-4e4d-bc89-93673cf4468c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:25.821033 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d77826b8-a707-4e4d-bc89-93673cf4468c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:25.828311 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d77826b8-a707-4e4d-bc89-93673cf4468c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:25.829084 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d77826b8-a707-4e4d-bc89-93673cf4468c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:25.829752 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d77826b8-a707-4e4d-bc89-93673cf4468c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:25.830722 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d77826b8-a707-4e4d-bc89-93673cf4468c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:25.831581 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d77826b8-a707-4e4d-bc89-93673cf4468c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:25.832197 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d77826b8-a707-4e4d-bc89-93673cf4468c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:25.946996 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-6537d4f3-c7e6-4206-90ee-c9281acbbe8d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Action: 'create', calling method: .version_select at 0x7f85fe3e7700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1844905335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd1crZE81ogRaxrL6nYisaM6tIMpfgOrPjWZIklXjURUoBjYBepS5yilQDbzzPeZ3g0TbInR4QF0t8J3HELexj0HPiwcScOjBKeQFx9EzV8RjMUOVZQEZoJ9tylwCw8DQ=="}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:46:25.965186 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-6537d4f3-c7e6-4206-90ee-c9281acbbe8d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Getting quotas for project 8e81ed7b06f84b2bab3369334cb1f90a. Resources: {'key_pairs'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:46:25.969628 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-6537d4f3-c7e6-4206-90ee-c9281acbbe8d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Getting quotas for user cf6e346e96144628ac25c428be38870a and project 8e81ed7b06f84b2bab3369334cb1f90a. Resources: {'key_pairs'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:46:26.012767 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-6537d4f3-c7e6-4206-90ee-c9281acbbe8d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.434272 Aug 17 23:46:26.017428 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 230/464] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Aug 17 23:46:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:46:26.019271 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d77826b8-a707-4e4d-bc89-93673cf4468c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:26.028392 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d77826b8-a707-4e4d-bc89-93673cf4468c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1370 microversion: 2.1 time: 0.215003 Aug 17 23:46:26.029773 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 235/465] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:25 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:27.052310 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-809cef4d-fb10-4b32-bbe9-072c474e540e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:27.052933 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-809cef4d-fb10-4b32-bbe9-072c474e540e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:27.061886 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-809cef4d-fb10-4b32-bbe9-072c474e540e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:27.062389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-809cef4d-fb10-4b32-bbe9-072c474e540e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:27.062832 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-809cef4d-fb10-4b32-bbe9-072c474e540e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:27.063538 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-809cef4d-fb10-4b32-bbe9-072c474e540e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:27.064022 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-809cef4d-fb10-4b32-bbe9-072c474e540e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:27.064684 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-809cef4d-fb10-4b32-bbe9-072c474e540e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:27.216615 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-809cef4d-fb10-4b32-bbe9-072c474e540e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:27.225119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-809cef4d-fb10-4b32-bbe9-072c474e540e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1370 microversion: 2.1 time: 0.178575 Aug 17 23:46:27.226065 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 231/466] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:27 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:28.250542 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-4f8ba810-e88f-4301-912f-5dbd3a1b1999 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:28.253011 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-4f8ba810-e88f-4301-912f-5dbd3a1b1999 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:28.279298 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4f8ba810-e88f-4301-912f-5dbd3a1b1999 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:28.280079 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4f8ba810-e88f-4301-912f-5dbd3a1b1999 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:28.285155 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4f8ba810-e88f-4301-912f-5dbd3a1b1999 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:28.286546 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4f8ba810-e88f-4301-912f-5dbd3a1b1999 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:28.289294 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4f8ba810-e88f-4301-912f-5dbd3a1b1999 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:28.292191 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4f8ba810-e88f-4301-912f-5dbd3a1b1999 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:28.463097 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-4f8ba810-e88f-4301-912f-5dbd3a1b1999 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:28.472699 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-4f8ba810-e88f-4301-912f-5dbd3a1b1999 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1370 microversion: 2.1 time: 0.230345 Aug 17 23:46:28.473806 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 236/467] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:28 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:29.495424 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e5de4fdd-795d-4f72-b94e-e482c7c428e9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:29.496864 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e5de4fdd-795d-4f72-b94e-e482c7c428e9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:29.517517 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e5de4fdd-795d-4f72-b94e-e482c7c428e9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:29.518116 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e5de4fdd-795d-4f72-b94e-e482c7c428e9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:29.518633 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e5de4fdd-795d-4f72-b94e-e482c7c428e9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:29.519424 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e5de4fdd-795d-4f72-b94e-e482c7c428e9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:29.519955 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e5de4fdd-795d-4f72-b94e-e482c7c428e9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:29.520511 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e5de4fdd-795d-4f72-b94e-e482c7c428e9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:29.940399 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e5de4fdd-795d-4f72-b94e-e482c7c428e9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:29.969511 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e5de4fdd-795d-4f72-b94e-e482c7c428e9 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1370 microversion: 2.1 time: 0.478132 Aug 17 23:46:29.971433 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 232/468] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:29 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1370 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:30.992721 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-6a01556d-cf5d-480e-a150-0b93e277b313 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:30.993620 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-6a01556d-cf5d-480e-a150-0b93e277b313 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:30.997371 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=2 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:46:30.998487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=10 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:46:31.009259 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6a01556d-cf5d-480e-a150-0b93e277b313 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:31.012546 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6a01556d-cf5d-480e-a150-0b93e277b313 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:31.013914 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6a01556d-cf5d-480e-a150-0b93e277b313 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:31.015241 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6a01556d-cf5d-480e-a150-0b93e277b313 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:31.015948 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6a01556d-cf5d-480e-a150-0b93e277b313 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:31.016655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6a01556d-cf5d-480e-a150-0b93e277b313 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:31.208134 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-6a01556d-cf5d-480e-a150-0b93e277b313 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:31.212609 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:46:31.228266 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-6a01556d-cf5d-480e-a150-0b93e277b313 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1370 microversion: 2.1 time: 0.237242 Aug 17 23:46:31.242849 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 237/469] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:30 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1370 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:32.251288 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2c70c7c4-5c53-4b13-8c1a-ffb6f4eead17 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:32.252613 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2c70c7c4-5c53-4b13-8c1a-ffb6f4eead17 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:32.259640 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2c70c7c4-5c53-4b13-8c1a-ffb6f4eead17 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:32.261956 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2c70c7c4-5c53-4b13-8c1a-ffb6f4eead17 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:32.262595 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2c70c7c4-5c53-4b13-8c1a-ffb6f4eead17 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:32.263501 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2c70c7c4-5c53-4b13-8c1a-ffb6f4eead17 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:32.264155 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2c70c7c4-5c53-4b13-8c1a-ffb6f4eead17 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:32.264762 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2c70c7c4-5c53-4b13-8c1a-ffb6f4eead17 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:32.493934 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2c70c7c4-5c53-4b13-8c1a-ffb6f4eead17 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:32.509841 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2c70c7c4-5c53-4b13-8c1a-ffb6f4eead17 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1370 microversion: 2.1 time: 0.262722 Aug 17 23:46:32.512080 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 233/470] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:32 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1370 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:33.533134 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c6c0eefd-8d77-4a98-9504-8f7f40b66da1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:33.534464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c6c0eefd-8d77-4a98-9504-8f7f40b66da1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:33.545076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c6c0eefd-8d77-4a98-9504-8f7f40b66da1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:33.545574 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c6c0eefd-8d77-4a98-9504-8f7f40b66da1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:33.546487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c6c0eefd-8d77-4a98-9504-8f7f40b66da1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:33.548053 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c6c0eefd-8d77-4a98-9504-8f7f40b66da1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:33.548729 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c6c0eefd-8d77-4a98-9504-8f7f40b66da1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:33.554856 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c6c0eefd-8d77-4a98-9504-8f7f40b66da1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:33.951326 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c6c0eefd-8d77-4a98-9504-8f7f40b66da1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:33.959496 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c6c0eefd-8d77-4a98-9504-8f7f40b66da1 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1370 microversion: 2.1 time: 0.432078 Aug 17 23:46:33.960115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 238/471] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:33 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1370 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:34.448144 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-d0caf6a5-1a17-4ddf-830a-304605ba388c req-c073ded2-42a5-41e9-99db-0f5ec86c07c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b73d6d-ce40-4adb-bbd2-7ac326eb758a", "name": "network-vif-plugged", "status": "completed", "tag": "a7bb89fa-fcc0-415d-8ac1-70d1ad224517"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:46:34.459085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-d0caf6a5-1a17-4ddf-830a-304605ba388c req-c073ded2-42a5-41e9-99db-0f5ec86c07c0 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:34.459880 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-d0caf6a5-1a17-4ddf-830a-304605ba388c req-c073ded2-42a5-41e9-99db-0f5ec86c07c0 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:34.460481 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-d0caf6a5-1a17-4ddf-830a-304605ba388c req-c073ded2-42a5-41e9-99db-0f5ec86c07c0 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:34.464546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=97 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:46:34.474917 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-d0caf6a5-1a17-4ddf-830a-304605ba388c req-c073ded2-42a5-41e9-99db-0f5ec86c07c0 service nova] Creating event network-vif-plugged:a7bb89fa-fcc0-415d-8ac1-70d1ad224517 for instance 20b73d6d-ce40-4adb-bbd2-7ac326eb758a on hv-cinder-82002 Aug 17 23:46:34.490238 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-d0caf6a5-1a17-4ddf-830a-304605ba388c req-c073ded2-42a5-41e9-99db-0f5ec86c07c0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045685 Aug 17 23:46:34.491148 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 234/472] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:46:34.982619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e52e9cbc-f249-4d7a-8294-a6b7a5759e62 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:34.983987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e52e9cbc-f249-4d7a-8294-a6b7a5759e62 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:34.991131 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e52e9cbc-f249-4d7a-8294-a6b7a5759e62 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:34.991767 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e52e9cbc-f249-4d7a-8294-a6b7a5759e62 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:34.992362 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e52e9cbc-f249-4d7a-8294-a6b7a5759e62 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:34.993231 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e52e9cbc-f249-4d7a-8294-a6b7a5759e62 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:34.993875 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e52e9cbc-f249-4d7a-8294-a6b7a5759e62 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:34.994619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e52e9cbc-f249-4d7a-8294-a6b7a5759e62 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:35.184609 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e52e9cbc-f249-4d7a-8294-a6b7a5759e62 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:35.193584 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e52e9cbc-f249-4d7a-8294-a6b7a5759e62 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1370 microversion: 2.1 time: 0.216209 Aug 17 23:46:35.194437 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 239/473] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:34 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:36.211858 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=6 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:46:36.216958 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-87dd4864-fea6-4078-b1a2-af64b4181885 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:36.218172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-87dd4864-fea6-4078-b1a2-af64b4181885 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:36.225102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-87dd4864-fea6-4078-b1a2-af64b4181885 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:36.226286 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-87dd4864-fea6-4078-b1a2-af64b4181885 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:36.226970 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-87dd4864-fea6-4078-b1a2-af64b4181885 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:36.228312 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-87dd4864-fea6-4078-b1a2-af64b4181885 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:36.229494 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-87dd4864-fea6-4078-b1a2-af64b4181885 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:36.230130 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-87dd4864-fea6-4078-b1a2-af64b4181885 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:36.467475 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-87dd4864-fea6-4078-b1a2-af64b4181885 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:36.477671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-87dd4864-fea6-4078-b1a2-af64b4181885 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1370 microversion: 2.1 time: 0.265458 Aug 17 23:46:36.478443 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 235/474] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:36 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1370 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:37.502232 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e6ddc6f1-57a8-4ace-a029-3b008038b5b5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:37.503444 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e6ddc6f1-57a8-4ace-a029-3b008038b5b5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:37.519620 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e6ddc6f1-57a8-4ace-a029-3b008038b5b5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:37.520793 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e6ddc6f1-57a8-4ace-a029-3b008038b5b5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:37.521468 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e6ddc6f1-57a8-4ace-a029-3b008038b5b5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:37.523003 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e6ddc6f1-57a8-4ace-a029-3b008038b5b5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:37.524616 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e6ddc6f1-57a8-4ace-a029-3b008038b5b5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:37.526614 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e6ddc6f1-57a8-4ace-a029-3b008038b5b5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:37.781515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e6ddc6f1-57a8-4ace-a029-3b008038b5b5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:37.790739 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e6ddc6f1-57a8-4ace-a029-3b008038b5b5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1564 microversion: 2.1 time: 0.295099 Aug 17 23:46:37.810610 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 240/475] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:37 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1564 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:37.833684 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-009d54dc-1109-4496-896a-43174e616f5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:37.834230 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-009d54dc-1109-4496-896a-43174e616f5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:37.849004 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-009d54dc-1109-4496-896a-43174e616f5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:37.849004 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-009d54dc-1109-4496-896a-43174e616f5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:37.849289 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-009d54dc-1109-4496-896a-43174e616f5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:37.849996 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-009d54dc-1109-4496-896a-43174e616f5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:37.850464 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-009d54dc-1109-4496-896a-43174e616f5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:37.850891 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-009d54dc-1109-4496-896a-43174e616f5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:38.002567 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-009d54dc-1109-4496-896a-43174e616f5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.174372 Aug 17 23:46:38.004006 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 236/476] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Aug 17 23:46:37 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:46:39.861178 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-3e70cda6-be65-4257-bf9c-a7dce5a6648d req-e63a4ab0-6d9f-4093-bcfa-aab77ea6e589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b73d6d-ce40-4adb-bbd2-7ac326eb758a", "tag": "a7bb89fa-fcc0-415d-8ac1-70d1ad224517"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:46:39.880901 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-3e70cda6-be65-4257-bf9c-a7dce5a6648d req-e63a4ab0-6d9f-4093-bcfa-aab77ea6e589 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:39.882444 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-3e70cda6-be65-4257-bf9c-a7dce5a6648d req-e63a4ab0-6d9f-4093-bcfa-aab77ea6e589 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:39.884003 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-3e70cda6-be65-4257-bf9c-a7dce5a6648d req-e63a4ab0-6d9f-4093-bcfa-aab77ea6e589 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:39.896504 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-3e70cda6-be65-4257-bf9c-a7dce5a6648d req-e63a4ab0-6d9f-4093-bcfa-aab77ea6e589 service nova] Creating event network-changed:a7bb89fa-fcc0-415d-8ac1-70d1ad224517 for instance 20b73d6d-ce40-4adb-bbd2-7ac326eb758a on hv-cinder-82002 Aug 17 23:46:39.903819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-3e70cda6-be65-4257-bf9c-a7dce5a6648d req-e63a4ab0-6d9f-4093-bcfa-aab77ea6e589 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051544 Aug 17 23:46:39.905233 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 241/477] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:46:41.956282 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-87af00eb-eaca-441b-8e4a-30a340c9c272 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Action: 'create', calling method: .version_select at 0x7f85fe449040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1853072573", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRv7Wpuqrx040cKA0ZDAs2f/Cli4z4N4J7DIV9Qa36ji+wOjFZQKrmmKDStd7Plnfz9W34C+oM2rI5qqcU54YaDxW9PZr2R7D+s4GavXQD2hgcZpP6F4kZS/f6i+s0V+A=="}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:46:41.981097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-87af00eb-eaca-441b-8e4a-30a340c9c272 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Getting quotas for project aac208652b8247049fa6a0bc9aa991bf. Resources: {'key_pairs'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:46:41.987147 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-87af00eb-eaca-441b-8e4a-30a340c9c272 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Getting quotas for user ce1b5129d46345ef99c69e95f9824c45 and project aac208652b8247049fa6a0bc9aa991bf. Resources: {'key_pairs'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:46:42.028929 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-87af00eb-eaca-441b-8e4a-30a340c9c272 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.333144 Aug 17 23:46:42.030693 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 237/478] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Aug 17 23:46:41 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:46:46.441878 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-27887a74-4c3a-438e-ae9f-6afb15772cb0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:46.443290 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-27887a74-4c3a-438e-ae9f-6afb15772cb0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:46.450919 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-27887a74-4c3a-438e-ae9f-6afb15772cb0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:46.451413 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-27887a74-4c3a-438e-ae9f-6afb15772cb0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:46.451856 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-27887a74-4c3a-438e-ae9f-6afb15772cb0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:46.452766 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-27887a74-4c3a-438e-ae9f-6afb15772cb0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:46.453228 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-27887a74-4c3a-438e-ae9f-6afb15772cb0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:46.453811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-27887a74-4c3a-438e-ae9f-6afb15772cb0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:46.482971 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-27887a74-4c3a-438e-ae9f-6afb15772cb0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73/ips" status: 200 len: 150 microversion: 2.1 time: 0.047757 Aug 17 23:46:46.483551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 242/479] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Aug 17 23:46:46 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:46:49.157466 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=11 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:46:49.162237 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-754edabd-ac9e-466c-b434-59e780a600c6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c325da96-83c2-41da-a9c6-a765d32da165"}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:46:49.164593 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-754edabd-ac9e-466c-b434-59e780a600c6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:49.166516 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:46:49.184872 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-754edabd-ac9e-466c-b434-59e780a600c6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:49.185149 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-754edabd-ac9e-466c-b434-59e780a600c6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:49.185592 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-754edabd-ac9e-466c-b434-59e780a600c6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:49.186309 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-754edabd-ac9e-466c-b434-59e780a600c6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:49.193663 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-754edabd-ac9e-466c-b434-59e780a600c6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:49.194118 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-754edabd-ac9e-466c-b434-59e780a600c6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:49.768174 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-754edabd-ac9e-466c-b434-59e780a600c6 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "POST /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.610518 Aug 17 23:46:49.769096 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 238/480] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 17 23:46:49 2022] POST /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73/os-volume_attachments => generated 194 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:46:54.171445 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-af0b5479-c233-4243-ab17-e3c09574988f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-435665921", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1844905335", "security_groups": [{"name": "tempest-secgroup-smoke-1359277404"}], "block_device_mapping_v2": [{"uuid": "31497b97-ffe0-43b7-8d71-acf42411be81", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "767a2b34-2391-4975-a5de-d7b63e2cf978"}]}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:46:54.192747 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=24 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:46:54.324571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.network.neutron [None req-af0b5479-c233-4243-ab17-e3c09574988f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] validate_networks() for [('767a2b34-2391-4975-a5de-d7b63e2cf978', None, None, None, None, None)] {{(pid=131394) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:46:54.846133 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-af0b5479-c233-4243-ab17-e3c09574988f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Flavor limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:46:54.846865 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-af0b5479-c233-4243-ab17-e3c09574988f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Image limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:46:54.847344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-af0b5479-c233-4243-ab17-e3c09574988f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Flavor pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:46:54.847758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-af0b5479-c233-4243-ab17-e3c09574988f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Image pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:46:54.848203 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-af0b5479-c233-4243-ab17-e3c09574988f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:46:54.866497 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af0b5479-c233-4243-ab17-e3c09574988f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:54.867279 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af0b5479-c233-4243-ab17-e3c09574988f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:54.867906 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af0b5479-c233-4243-ab17-e3c09574988f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:54.869520 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af0b5479-c233-4243-ab17-e3c09574988f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:54.869989 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af0b5479-c233-4243-ab17-e3c09574988f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:54.870419 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af0b5479-c233-4243-ab17-e3c09574988f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:54.893949 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-af0b5479-c233-4243-ab17-e3c09574988f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Getting quotas for project 8e81ed7b06f84b2bab3369334cb1f90a. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:46:54.898291 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-af0b5479-c233-4243-ab17-e3c09574988f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Getting quotas for user cf6e346e96144628ac25c428be38870a and project 8e81ed7b06f84b2bab3369334cb1f90a. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:46:55.014426 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-af0b5479-c233-4243-ab17-e3c09574988f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Going to run 1 instances... {{(pid=131394) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:46:55.016569 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-af0b5479-c233-4243-ab17-e3c09574988f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='31497b97-ffe0-43b7-8d71-acf42411be81',volume_size=None,volume_type=None)] {{(pid=131394) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:46:55.205188 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-af0b5479-c233-4243-ab17-e3c09574988f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.037738 Aug 17 23:46:55.206636 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 243/481] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 17 23:46:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 23:46:55.218448 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f28c8c59-4911-4533-8be1-3b579a35c614 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:55.219166 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f28c8c59-4911-4533-8be1-3b579a35c614 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:55.224261 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=4 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:46:55.365928 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f28c8c59-4911-4533-8be1-3b579a35c614 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:55.375265 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f28c8c59-4911-4533-8be1-3b579a35c614 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1094 microversion: 2.1 time: 0.160913 Aug 17 23:46:55.376222 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 239/482] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:55 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1094 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:56.404648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8786122a-bafc-452d-922d-d39605802899 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:56.405406 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8786122a-bafc-452d-922d-d39605802899 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:56.417115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8786122a-bafc-452d-922d-d39605802899 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:56.417614 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8786122a-bafc-452d-922d-d39605802899 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:56.418053 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8786122a-bafc-452d-922d-d39605802899 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:56.422863 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8786122a-bafc-452d-922d-d39605802899 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:56.439847 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8786122a-bafc-452d-922d-d39605802899 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:56.441139 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8786122a-bafc-452d-922d-d39605802899 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:56.540979 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-8786122a-bafc-452d-922d-d39605802899 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:56.552129 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8786122a-bafc-452d-922d-d39605802899 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1144 microversion: 2.1 time: 0.151540 Aug 17 23:46:56.552778 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 244/483] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:56 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1144 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:57.577790 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-edff4b4a-f499-4fba-853e-6e5906d77c33 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:57.579476 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-edff4b4a-f499-4fba-853e-6e5906d77c33 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:57.587702 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-edff4b4a-f499-4fba-853e-6e5906d77c33 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:57.588529 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-edff4b4a-f499-4fba-853e-6e5906d77c33 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:57.589522 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-edff4b4a-f499-4fba-853e-6e5906d77c33 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:57.590557 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-edff4b4a-f499-4fba-853e-6e5906d77c33 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:57.591231 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-edff4b4a-f499-4fba-853e-6e5906d77c33 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:57.591866 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-edff4b4a-f499-4fba-853e-6e5906d77c33 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:57.612671 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-caea401d-f0bb-4dd1-b003-de8a68b7913d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Action: 'create', calling method: .version_select at 0x7f85fdab6a60>, body: {"keypair": {"name": "tempest-keypair-848511599", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYcJDAoAHZ7lEEZTwTKhk7a0Le+UyeChiVCP8H9+yTS2fwmyBx53xqVSOeJbyk9QcKL/URgJATGAVv5yZbcUHMtWxgtG25eK0p5n/ngr0ZsyKglmckQTxT8xf1SNgq8dw=="}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:46:57.642430 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-caea401d-f0bb-4dd1-b003-de8a68b7913d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Getting quotas for project 258851d93c2d466a85150116d68441b6. Resources: {'key_pairs'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:46:57.650620 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-caea401d-f0bb-4dd1-b003-de8a68b7913d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Getting quotas for user 21e06d9bb5a240459ef3298a990a42f2 and project 258851d93c2d466a85150116d68441b6. Resources: {'key_pairs'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:46:57.702328 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-edff4b4a-f499-4fba-853e-6e5906d77c33 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:57.715879 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-edff4b4a-f499-4fba-853e-6e5906d77c33 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1192 microversion: 2.1 time: 0.142174 Aug 17 23:46:57.716487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-caea401d-f0bb-4dd1-b003-de8a68b7913d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.112299 Aug 17 23:46:57.717285 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 240/484] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:57 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1192 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:46:57.721099 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 245/485] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Aug 17 23:46:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:46:58.747160 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-8b095109-0259-4f53-9664-6657c6f0ada5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:46:58.747782 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-8b095109-0259-4f53-9664-6657c6f0ada5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:46:58.764700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8b095109-0259-4f53-9664-6657c6f0ada5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:58.765466 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8b095109-0259-4f53-9664-6657c6f0ada5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:58.766597 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8b095109-0259-4f53-9664-6657c6f0ada5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:58.770283 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8b095109-0259-4f53-9664-6657c6f0ada5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:46:58.772727 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8b095109-0259-4f53-9664-6657c6f0ada5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:46:58.773885 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8b095109-0259-4f53-9664-6657c6f0ada5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:46:59.412777 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8b095109-0259-4f53-9664-6657c6f0ada5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:46:59.429251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-8b095109-0259-4f53-9664-6657c6f0ada5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1210 microversion: 2.1 time: 0.686253 Aug 17 23:46:59.444353 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 241/486] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:46:58 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1210 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:00.194032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-4069abf2-65fd-4587-ae8b-6e12687aca49 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-470496299", "imageRef": "a3cf81e5-e973-4c08-b1da-4e8f104b52a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1116845-6414-4feb-bcc7-64852b6be391"}], "security_groups": [{"name": "tempest-securitygroup--352525890"}], "key_name": "tempest-keypair-848511599", "user_data": "}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:47:00.338797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.network.neutron [None req-4069abf2-65fd-4587-ae8b-6e12687aca49 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] validate_networks() for [('d1116845-6414-4feb-bcc7-64852b6be391', None, None, None, None, None)] {{(pid=131394) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:47:00.451108 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3a89dd02-e73a-4184-8fb2-b1c9718a03d2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:00.452410 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3a89dd02-e73a-4184-8fb2-b1c9718a03d2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:00.463712 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3a89dd02-e73a-4184-8fb2-b1c9718a03d2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:00.464722 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3a89dd02-e73a-4184-8fb2-b1c9718a03d2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:00.465367 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3a89dd02-e73a-4184-8fb2-b1c9718a03d2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:00.466574 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3a89dd02-e73a-4184-8fb2-b1c9718a03d2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:00.467181 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3a89dd02-e73a-4184-8fb2-b1c9718a03d2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:00.467767 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3a89dd02-e73a-4184-8fb2-b1c9718a03d2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:00.706113 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3a89dd02-e73a-4184-8fb2-b1c9718a03d2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:00.715082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3a89dd02-e73a-4184-8fb2-b1c9718a03d2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.268314 Aug 17 23:47:00.715660 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 242/487] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:00 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:00.854218 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-dd0b3fd7-bf15-47c0-949e-3de5c9c722be req-34af4ec6-249f-48e3-9232-367ee01bff4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12c673bc-cdc2-486b-a556-c6ce9a3fdb6c", "tag": "353d5d74-5ab4-43f3-b3ae-b06325dafe66"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:47:00.864815 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-dd0b3fd7-bf15-47c0-949e-3de5c9c722be req-34af4ec6-249f-48e3-9232-367ee01bff4b service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:00.865584 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-dd0b3fd7-bf15-47c0-949e-3de5c9c722be req-34af4ec6-249f-48e3-9232-367ee01bff4b service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:00.866218 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-dd0b3fd7-bf15-47c0-949e-3de5c9c722be req-34af4ec6-249f-48e3-9232-367ee01bff4b service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:00.880061 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-dd0b3fd7-bf15-47c0-949e-3de5c9c722be req-34af4ec6-249f-48e3-9232-367ee01bff4b service nova] Creating event network-changed:353d5d74-5ab4-43f3-b3ae-b06325dafe66 for instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c on hv-cinder-82002 Aug 17 23:47:00.885616 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-dd0b3fd7-bf15-47c0-949e-3de5c9c722be req-34af4ec6-249f-48e3-9232-367ee01bff4b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036233 Aug 17 23:47:00.886708 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 243/488] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:47:01.002468 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-4069abf2-65fd-4587-ae8b-6e12687aca49 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Flavor limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:47:01.003510 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-4069abf2-65fd-4587-ae8b-6e12687aca49 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Image limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:47:01.004218 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-4069abf2-65fd-4587-ae8b-6e12687aca49 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Flavor pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:47:01.004787 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-4069abf2-65fd-4587-ae8b-6e12687aca49 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Image pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:47:01.005379 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-4069abf2-65fd-4587-ae8b-6e12687aca49 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:47:01.019751 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4069abf2-65fd-4587-ae8b-6e12687aca49 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:01.020609 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4069abf2-65fd-4587-ae8b-6e12687aca49 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:01.021230 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4069abf2-65fd-4587-ae8b-6e12687aca49 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:01.022118 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4069abf2-65fd-4587-ae8b-6e12687aca49 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:01.022940 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4069abf2-65fd-4587-ae8b-6e12687aca49 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:01.024016 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4069abf2-65fd-4587-ae8b-6e12687aca49 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:01.048149 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-4069abf2-65fd-4587-ae8b-6e12687aca49 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Getting quotas for project 258851d93c2d466a85150116d68441b6. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:47:01.052977 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-4069abf2-65fd-4587-ae8b-6e12687aca49 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Getting quotas for user 21e06d9bb5a240459ef3298a990a42f2 and project 258851d93c2d466a85150116d68441b6. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:47:01.069046 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-4069abf2-65fd-4587-ae8b-6e12687aca49 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Going to run 1 instances... {{(pid=131394) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:47:01.071377 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-4069abf2-65fd-4587-ae8b-6e12687aca49 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a3cf81e5-e973-4c08-b1da-4e8f104b52a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131394) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:47:01.132384 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-4069abf2-65fd-4587-ae8b-6e12687aca49 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.943403 Aug 17 23:47:01.139634 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 246/489] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 17 23:47:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 23:47:01.147254 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-469561c9-a5ef-4c99-a0b5-3443bdbac536 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:01.148199 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-469561c9-a5ef-4c99-a0b5-3443bdbac536 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:01.247085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-469561c9-a5ef-4c99-a0b5-3443bdbac536 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:01.254160 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-469561c9-a5ef-4c99-a0b5-3443bdbac536 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1240 microversion: 2.1 time: 0.112842 Aug 17 23:47:01.254933 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 244/490] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:01 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1240 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:01.737042 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e754cfce-7b98-4594-be7a-a66c29e0ffe1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:01.738246 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e754cfce-7b98-4594-be7a-a66c29e0ffe1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:01.746044 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e754cfce-7b98-4594-be7a-a66c29e0ffe1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:01.747457 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e754cfce-7b98-4594-be7a-a66c29e0ffe1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:01.748418 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e754cfce-7b98-4594-be7a-a66c29e0ffe1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:01.752179 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e754cfce-7b98-4594-be7a-a66c29e0ffe1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:01.752862 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e754cfce-7b98-4594-be7a-a66c29e0ffe1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:01.753462 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e754cfce-7b98-4594-be7a-a66c29e0ffe1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:01.910085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e754cfce-7b98-4594-be7a-a66c29e0ffe1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:01.920415 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e754cfce-7b98-4594-be7a-a66c29e0ffe1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.187247 Aug 17 23:47:01.921433 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 247/491] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:01 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:02.274973 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1bb48815-6d68-4c2e-b1e9-36774685e56a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:02.276245 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-1bb48815-6d68-4c2e-b1e9-36774685e56a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:02.285593 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1bb48815-6d68-4c2e-b1e9-36774685e56a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:02.286592 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1bb48815-6d68-4c2e-b1e9-36774685e56a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:02.287046 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1bb48815-6d68-4c2e-b1e9-36774685e56a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:02.287901 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1bb48815-6d68-4c2e-b1e9-36774685e56a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:02.288601 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1bb48815-6d68-4c2e-b1e9-36774685e56a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:02.289047 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1bb48815-6d68-4c2e-b1e9-36774685e56a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:02.365644 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1bb48815-6d68-4c2e-b1e9-36774685e56a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:02.375439 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-1bb48815-6d68-4c2e-b1e9-36774685e56a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1244 microversion: 2.1 time: 0.104551 Aug 17 23:47:02.376048 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 245/492] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:02 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1244 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:02.942909 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e9b2906f-f1e3-41a6-953c-5359e7fa6a47 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:02.944210 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e9b2906f-f1e3-41a6-953c-5359e7fa6a47 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:02.951042 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e9b2906f-f1e3-41a6-953c-5359e7fa6a47 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:02.951531 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e9b2906f-f1e3-41a6-953c-5359e7fa6a47 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:02.952159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e9b2906f-f1e3-41a6-953c-5359e7fa6a47 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:02.953036 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e9b2906f-f1e3-41a6-953c-5359e7fa6a47 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:02.953660 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e9b2906f-f1e3-41a6-953c-5359e7fa6a47 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:02.954091 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e9b2906f-f1e3-41a6-953c-5359e7fa6a47 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:03.104711 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e9b2906f-f1e3-41a6-953c-5359e7fa6a47 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:03.112489 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e9b2906f-f1e3-41a6-953c-5359e7fa6a47 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.173631 Aug 17 23:47:03.113064 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 248/493] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:02 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:03.197855 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-19434ada-07d9-4e4a-bb74-bbeb410c4993 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Action: 'create', calling method: .version_select at 0x7f85fe2c4ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1623198100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAKGI0TVGafCx2l037fZZL7nazJrL9azEV1kwA/BlWC/jTYmMqD8zsTM0msLrRFNS7tbP3EHsDyxTaMDMs12TMdSYGOIOqCDfK8Trxe63hYvDcoOHTRLuQNXGVQihC6aw=="}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:47:03.213913 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-19434ada-07d9-4e4a-bb74-bbeb410c4993 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Getting quotas for project b3ff5d4d64a740cabdc0144fe0b475ea. Resources: {'key_pairs'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:47:03.217845 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-19434ada-07d9-4e4a-bb74-bbeb410c4993 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Getting quotas for user 006f31b802f94549a517df90180dca36 and project b3ff5d4d64a740cabdc0144fe0b475ea. Resources: {'key_pairs'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:47:03.238926 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-19434ada-07d9-4e4a-bb74-bbeb410c4993 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.045406 Aug 17 23:47:03.239529 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 246/494] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Aug 17 23:47:03 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:47:03.293017 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c74eef12-919b-41aa-87fb-56f2d6c06f5b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-301762190", "imageRef": "ca19b647-103d-4095-929e-1feb90e4facc", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1623198100", "networks": [{"uuid": "e6eaa348-ad26-48f7-8933-2ddf75e65e4d"}]}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:47:03.348536 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.network.neutron [None req-c74eef12-919b-41aa-87fb-56f2d6c06f5b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] validate_networks() for [('e6eaa348-ad26-48f7-8933-2ddf75e65e4d', None, None, None, None, None)] {{(pid=131394) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:47:03.396605 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-89fcedaf-920e-4922-9c43-8bec857ea95d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:03.397456 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-89fcedaf-920e-4922-9c43-8bec857ea95d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:03.405660 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-89fcedaf-920e-4922-9c43-8bec857ea95d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:03.406249 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-89fcedaf-920e-4922-9c43-8bec857ea95d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:03.406774 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-89fcedaf-920e-4922-9c43-8bec857ea95d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:03.407882 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-89fcedaf-920e-4922-9c43-8bec857ea95d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:03.408694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-89fcedaf-920e-4922-9c43-8bec857ea95d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:03.409284 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-89fcedaf-920e-4922-9c43-8bec857ea95d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:03.478644 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-89fcedaf-920e-4922-9c43-8bec857ea95d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:03.486643 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-89fcedaf-920e-4922-9c43-8bec857ea95d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1292 microversion: 2.1 time: 0.094402 Aug 17 23:47:03.487242 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 247/495] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:03 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1292 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:03.929514 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-c74eef12-919b-41aa-87fb-56f2d6c06f5b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Flavor limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:47:03.929951 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-c74eef12-919b-41aa-87fb-56f2d6c06f5b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Image limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:47:03.930422 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-c74eef12-919b-41aa-87fb-56f2d6c06f5b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Flavor pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:47:03.931400 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-c74eef12-919b-41aa-87fb-56f2d6c06f5b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Image pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:47:03.931828 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-c74eef12-919b-41aa-87fb-56f2d6c06f5b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:47:03.941450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c74eef12-919b-41aa-87fb-56f2d6c06f5b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:03.941998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c74eef12-919b-41aa-87fb-56f2d6c06f5b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:03.942400 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c74eef12-919b-41aa-87fb-56f2d6c06f5b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:03.943153 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c74eef12-919b-41aa-87fb-56f2d6c06f5b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:03.943714 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c74eef12-919b-41aa-87fb-56f2d6c06f5b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:03.944076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c74eef12-919b-41aa-87fb-56f2d6c06f5b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:03.951394 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=47 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:47:03.962820 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-c74eef12-919b-41aa-87fb-56f2d6c06f5b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Getting quotas for project b3ff5d4d64a740cabdc0144fe0b475ea. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:47:03.966637 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-c74eef12-919b-41aa-87fb-56f2d6c06f5b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Getting quotas for user 006f31b802f94549a517df90180dca36 and project b3ff5d4d64a740cabdc0144fe0b475ea. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:47:03.978163 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c74eef12-919b-41aa-87fb-56f2d6c06f5b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Going to run 1 instances... {{(pid=131394) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:47:03.980179 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c74eef12-919b-41aa-87fb-56f2d6c06f5b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca19b647-103d-4095-929e-1feb90e4facc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131394) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:47:04.034082 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c74eef12-919b-41aa-87fb-56f2d6c06f5b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745233 Aug 17 23:47:04.034862 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 249/496] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 17 23:47:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 23:47:04.046544 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-62e879a0-802e-471a-9433-f8e5ac812a0c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:04.047406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-62e879a0-802e-471a-9433-f8e5ac812a0c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:04.115189 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-62e879a0-802e-471a-9433-f8e5ac812a0c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:04.122354 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-62e879a0-802e-471a-9433-f8e5ac812a0c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1258 microversion: 2.1 time: 0.079587 Aug 17 23:47:04.122884 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 248/497] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:04 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1258 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:04.135873 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f3e7488e-e828-49ee-a727-c3deb88750cc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:04.136822 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f3e7488e-e828-49ee-a727-c3deb88750cc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:04.143646 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f3e7488e-e828-49ee-a727-c3deb88750cc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:04.144167 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f3e7488e-e828-49ee-a727-c3deb88750cc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:04.144608 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f3e7488e-e828-49ee-a727-c3deb88750cc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:04.145306 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f3e7488e-e828-49ee-a727-c3deb88750cc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:04.145764 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f3e7488e-e828-49ee-a727-c3deb88750cc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:04.146191 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f3e7488e-e828-49ee-a727-c3deb88750cc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:04.290706 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f3e7488e-e828-49ee-a727-c3deb88750cc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:04.298576 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f3e7488e-e828-49ee-a727-c3deb88750cc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.167660 Aug 17 23:47:04.299132 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 250/498] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:04 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:04.508802 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-bfbfe84b-b3ac-4363-b94d-cd75a537a325 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:04.510723 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-bfbfe84b-b3ac-4363-b94d-cd75a537a325 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:04.531852 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bfbfe84b-b3ac-4363-b94d-cd75a537a325 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:04.532736 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bfbfe84b-b3ac-4363-b94d-cd75a537a325 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:04.533193 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bfbfe84b-b3ac-4363-b94d-cd75a537a325 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:04.533924 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bfbfe84b-b3ac-4363-b94d-cd75a537a325 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:04.534389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bfbfe84b-b3ac-4363-b94d-cd75a537a325 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:04.534823 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bfbfe84b-b3ac-4363-b94d-cd75a537a325 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:04.623153 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-bfbfe84b-b3ac-4363-b94d-cd75a537a325 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:04.631523 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-bfbfe84b-b3ac-4363-b94d-cd75a537a325 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1298 microversion: 2.1 time: 0.126836 Aug 17 23:47:04.632459 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 249/499] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:04 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1298 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:05.142896 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-4c2dbdc8-4689-4573-879e-d7ce5298dbb5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:05.143507 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-4c2dbdc8-4689-4573-879e-d7ce5298dbb5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:05.150111 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4c2dbdc8-4689-4573-879e-d7ce5298dbb5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:05.150599 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4c2dbdc8-4689-4573-879e-d7ce5298dbb5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:05.151142 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4c2dbdc8-4689-4573-879e-d7ce5298dbb5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:05.151728 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4c2dbdc8-4689-4573-879e-d7ce5298dbb5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:05.152213 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4c2dbdc8-4689-4573-879e-d7ce5298dbb5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:05.153649 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4c2dbdc8-4689-4573-879e-d7ce5298dbb5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:05.218547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-4c2dbdc8-4689-4573-879e-d7ce5298dbb5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:05.227354 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-4c2dbdc8-4689-4573-879e-d7ce5298dbb5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1318 microversion: 2.1 time: 0.088385 Aug 17 23:47:05.228022 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 251/500] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:05 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1318 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:05.320376 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-372fbae3-d7bb-47d7-af65-b71f2c3e507f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:05.321088 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-372fbae3-d7bb-47d7-af65-b71f2c3e507f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:05.330077 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-372fbae3-d7bb-47d7-af65-b71f2c3e507f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:05.330647 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-372fbae3-d7bb-47d7-af65-b71f2c3e507f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:05.331160 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-372fbae3-d7bb-47d7-af65-b71f2c3e507f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:05.331934 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-372fbae3-d7bb-47d7-af65-b71f2c3e507f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:05.332630 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-372fbae3-d7bb-47d7-af65-b71f2c3e507f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:05.333219 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-372fbae3-d7bb-47d7-af65-b71f2c3e507f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:05.495369 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-c50a1642-bc44-4d50-aa9f-2b2bf44eb70e req-f7b659cd-6e64-4a18-ac4a-d31ed0f3d887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3", "tag": "dfa9d9dc-5ba7-401c-ba5e-15d6312bb95f"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:47:05.508283 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-c50a1642-bc44-4d50-aa9f-2b2bf44eb70e req-f7b659cd-6e64-4a18-ac4a-d31ed0f3d887 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:05.509385 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-c50a1642-bc44-4d50-aa9f-2b2bf44eb70e req-f7b659cd-6e64-4a18-ac4a-d31ed0f3d887 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:05.509907 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-c50a1642-bc44-4d50-aa9f-2b2bf44eb70e req-f7b659cd-6e64-4a18-ac4a-d31ed0f3d887 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:05.531883 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-c50a1642-bc44-4d50-aa9f-2b2bf44eb70e req-f7b659cd-6e64-4a18-ac4a-d31ed0f3d887 service nova] Creating event network-changed:dfa9d9dc-5ba7-401c-ba5e-15d6312bb95f for instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 on hv-cinder-82002 Aug 17 23:47:05.538280 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-c50a1642-bc44-4d50-aa9f-2b2bf44eb70e req-f7b659cd-6e64-4a18-ac4a-d31ed0f3d887 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046400 Aug 17 23:47:05.539538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 252/501] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:47:05.654289 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-cf0474f8-8b21-428a-a881-67b8e1efc868 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:05.658359 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-cf0474f8-8b21-428a-a881-67b8e1efc868 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:05.665084 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cf0474f8-8b21-428a-a881-67b8e1efc868 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:05.665583 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cf0474f8-8b21-428a-a881-67b8e1efc868 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:05.666023 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cf0474f8-8b21-428a-a881-67b8e1efc868 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:05.666787 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cf0474f8-8b21-428a-a881-67b8e1efc868 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:05.667240 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cf0474f8-8b21-428a-a881-67b8e1efc868 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:05.670907 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-372fbae3-d7bb-47d7-af65-b71f2c3e507f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:05.675952 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cf0474f8-8b21-428a-a881-67b8e1efc868 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:05.681454 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-372fbae3-d7bb-47d7-af65-b71f2c3e507f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.364343 Aug 17 23:47:05.684669 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 250/502] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:05 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:05.855781 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-cf0474f8-8b21-428a-a881-67b8e1efc868 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:05.865329 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-cf0474f8-8b21-428a-a881-67b8e1efc868 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.215461 Aug 17 23:47:05.866193 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 253/503] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:05 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:06.249030 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9b24345d-148a-4739-8a19-be62e42e0a9b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:06.249644 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9b24345d-148a-4739-8a19-be62e42e0a9b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:06.256300 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9b24345d-148a-4739-8a19-be62e42e0a9b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:06.256795 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9b24345d-148a-4739-8a19-be62e42e0a9b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:06.257382 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9b24345d-148a-4739-8a19-be62e42e0a9b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:06.258112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9b24345d-148a-4739-8a19-be62e42e0a9b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:06.258610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9b24345d-148a-4739-8a19-be62e42e0a9b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:06.259578 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9b24345d-148a-4739-8a19-be62e42e0a9b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:06.403550 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9b24345d-148a-4739-8a19-be62e42e0a9b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:06.411208 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9b24345d-148a-4739-8a19-be62e42e0a9b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.165874 Aug 17 23:47:06.411768 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 251/504] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:06 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:06.705443 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-213c6780-4cb9-470b-ab07-b5ba66a5f81a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:06.706094 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-213c6780-4cb9-470b-ab07-b5ba66a5f81a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:06.713801 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-213c6780-4cb9-470b-ab07-b5ba66a5f81a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:06.714285 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-213c6780-4cb9-470b-ab07-b5ba66a5f81a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:06.714722 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-213c6780-4cb9-470b-ab07-b5ba66a5f81a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:06.715415 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-213c6780-4cb9-470b-ab07-b5ba66a5f81a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:06.715869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-213c6780-4cb9-470b-ab07-b5ba66a5f81a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:06.716318 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-213c6780-4cb9-470b-ab07-b5ba66a5f81a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:06.856162 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-213c6780-4cb9-470b-ab07-b5ba66a5f81a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:06.863559 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-213c6780-4cb9-470b-ab07-b5ba66a5f81a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.162225 Aug 17 23:47:06.864136 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 254/505] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:06 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:06.888982 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-09e4bed8-b8cd-44e4-9c86-e2daa34b618f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:06.889723 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-09e4bed8-b8cd-44e4-9c86-e2daa34b618f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:06.896041 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-09e4bed8-b8cd-44e4-9c86-e2daa34b618f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:06.896620 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-09e4bed8-b8cd-44e4-9c86-e2daa34b618f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:06.897133 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-09e4bed8-b8cd-44e4-9c86-e2daa34b618f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:06.897931 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-09e4bed8-b8cd-44e4-9c86-e2daa34b618f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:06.898466 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-09e4bed8-b8cd-44e4-9c86-e2daa34b618f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:06.898963 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-09e4bed8-b8cd-44e4-9c86-e2daa34b618f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:07.038567 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-09e4bed8-b8cd-44e4-9c86-e2daa34b618f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:07.046248 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-09e4bed8-b8cd-44e4-9c86-e2daa34b618f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.162036 Aug 17 23:47:07.047157 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 252/506] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:06 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:07.432057 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a6d437e3-907d-4f02-9fed-8d30fb363b59 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:07.432596 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a6d437e3-907d-4f02-9fed-8d30fb363b59 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:07.439005 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a6d437e3-907d-4f02-9fed-8d30fb363b59 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:07.439495 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a6d437e3-907d-4f02-9fed-8d30fb363b59 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:07.439931 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a6d437e3-907d-4f02-9fed-8d30fb363b59 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:07.440657 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a6d437e3-907d-4f02-9fed-8d30fb363b59 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:07.441108 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a6d437e3-907d-4f02-9fed-8d30fb363b59 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:07.441551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a6d437e3-907d-4f02-9fed-8d30fb363b59 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:07.572940 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a6d437e3-907d-4f02-9fed-8d30fb363b59 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:07.580336 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a6d437e3-907d-4f02-9fed-8d30fb363b59 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.152787 Aug 17 23:47:07.580902 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 255/507] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:07 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:07.884211 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-22c48869-de24-47e5-9a3a-27241ebffd87 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:07.885241 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-22c48869-de24-47e5-9a3a-27241ebffd87 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:07.892249 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22c48869-de24-47e5-9a3a-27241ebffd87 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:07.892836 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22c48869-de24-47e5-9a3a-27241ebffd87 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:07.893313 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22c48869-de24-47e5-9a3a-27241ebffd87 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:07.894126 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22c48869-de24-47e5-9a3a-27241ebffd87 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:07.894665 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22c48869-de24-47e5-9a3a-27241ebffd87 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:07.895166 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22c48869-de24-47e5-9a3a-27241ebffd87 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:08.030648 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-22c48869-de24-47e5-9a3a-27241ebffd87 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:08.038880 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-22c48869-de24-47e5-9a3a-27241ebffd87 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.158617 Aug 17 23:47:08.050044 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 253/508] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:07 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:08.066623 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d92ccf8c-6d9f-4545-ac22-b2971cd89166 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:08.067246 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d92ccf8c-6d9f-4545-ac22-b2971cd89166 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:08.073723 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d92ccf8c-6d9f-4545-ac22-b2971cd89166 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:08.074208 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d92ccf8c-6d9f-4545-ac22-b2971cd89166 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:08.074650 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d92ccf8c-6d9f-4545-ac22-b2971cd89166 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:08.075337 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d92ccf8c-6d9f-4545-ac22-b2971cd89166 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:08.075803 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d92ccf8c-6d9f-4545-ac22-b2971cd89166 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:08.076250 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d92ccf8c-6d9f-4545-ac22-b2971cd89166 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:08.215252 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d92ccf8c-6d9f-4545-ac22-b2971cd89166 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:08.222698 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d92ccf8c-6d9f-4545-ac22-b2971cd89166 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.159935 Aug 17 23:47:08.223290 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 256/509] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:08 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:08.600942 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-46f8dbb0-04fe-42e5-ad96-ee5e7d957352 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:08.601547 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-46f8dbb0-04fe-42e5-ad96-ee5e7d957352 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:08.608038 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-46f8dbb0-04fe-42e5-ad96-ee5e7d957352 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:08.608518 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-46f8dbb0-04fe-42e5-ad96-ee5e7d957352 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:08.608949 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-46f8dbb0-04fe-42e5-ad96-ee5e7d957352 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:08.609856 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-46f8dbb0-04fe-42e5-ad96-ee5e7d957352 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:08.610312 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-46f8dbb0-04fe-42e5-ad96-ee5e7d957352 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:08.610729 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-46f8dbb0-04fe-42e5-ad96-ee5e7d957352 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:08.746939 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-46f8dbb0-04fe-42e5-ad96-ee5e7d957352 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:08.754413 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-46f8dbb0-04fe-42e5-ad96-ee5e7d957352 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.157412 Aug 17 23:47:08.755009 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 254/510] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:08 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:09.060745 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a3f38643-162d-42d1-85ca-e92c6d0820b0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:09.061392 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a3f38643-162d-42d1-85ca-e92c6d0820b0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:09.067411 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3f38643-162d-42d1-85ca-e92c6d0820b0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:09.068027 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3f38643-162d-42d1-85ca-e92c6d0820b0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:09.068477 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3f38643-162d-42d1-85ca-e92c6d0820b0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:09.069180 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3f38643-162d-42d1-85ca-e92c6d0820b0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:09.069635 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3f38643-162d-42d1-85ca-e92c6d0820b0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:09.070066 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3f38643-162d-42d1-85ca-e92c6d0820b0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:09.206025 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a3f38643-162d-42d1-85ca-e92c6d0820b0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:09.214380 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a3f38643-162d-42d1-85ca-e92c6d0820b0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.157426 Aug 17 23:47:09.215057 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 257/511] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:09 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:09.244724 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-8a3e80dc-0b45-4028-96aa-03e103d7fbea tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:09.245339 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-8a3e80dc-0b45-4028-96aa-03e103d7fbea tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:09.251985 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a3e80dc-0b45-4028-96aa-03e103d7fbea tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:09.252489 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a3e80dc-0b45-4028-96aa-03e103d7fbea tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:09.253038 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a3e80dc-0b45-4028-96aa-03e103d7fbea tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:09.253791 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a3e80dc-0b45-4028-96aa-03e103d7fbea tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:09.254255 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a3e80dc-0b45-4028-96aa-03e103d7fbea tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:09.254788 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a3e80dc-0b45-4028-96aa-03e103d7fbea tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:09.388982 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8a3e80dc-0b45-4028-96aa-03e103d7fbea tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:09.396556 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-8a3e80dc-0b45-4028-96aa-03e103d7fbea tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.156355 Aug 17 23:47:09.397126 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 255/512] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:09 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:09.775645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8fd07362-a7c4-4b7e-9985-432cd0e03875 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:09.776291 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8fd07362-a7c4-4b7e-9985-432cd0e03875 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:09.782203 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8fd07362-a7c4-4b7e-9985-432cd0e03875 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:09.782683 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8fd07362-a7c4-4b7e-9985-432cd0e03875 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:09.783119 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8fd07362-a7c4-4b7e-9985-432cd0e03875 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:09.783805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8fd07362-a7c4-4b7e-9985-432cd0e03875 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:09.784284 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8fd07362-a7c4-4b7e-9985-432cd0e03875 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:09.784704 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8fd07362-a7c4-4b7e-9985-432cd0e03875 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:09.917781 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-8fd07362-a7c4-4b7e-9985-432cd0e03875 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:09.925477 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8fd07362-a7c4-4b7e-9985-432cd0e03875 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.154262 Aug 17 23:47:09.926030 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 258/513] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:09 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:10.234684 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ccea8714-8b4b-4b7f-8476-d7a4a96f4fb3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:10.235292 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ccea8714-8b4b-4b7f-8476-d7a4a96f4fb3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:10.241768 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccea8714-8b4b-4b7f-8476-d7a4a96f4fb3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:10.242256 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccea8714-8b4b-4b7f-8476-d7a4a96f4fb3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:10.242702 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccea8714-8b4b-4b7f-8476-d7a4a96f4fb3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:10.243901 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccea8714-8b4b-4b7f-8476-d7a4a96f4fb3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:10.244380 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccea8714-8b4b-4b7f-8476-d7a4a96f4fb3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:10.244804 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccea8714-8b4b-4b7f-8476-d7a4a96f4fb3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:10.387720 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ccea8714-8b4b-4b7f-8476-d7a4a96f4fb3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:10.395383 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ccea8714-8b4b-4b7f-8476-d7a4a96f4fb3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.164602 Aug 17 23:47:10.395951 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 256/514] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:10 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:10.419244 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-7d559fb9-126e-44af-a4a6-3b430a32e892 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:10.419864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-7d559fb9-126e-44af-a4a6-3b430a32e892 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:10.427076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7d559fb9-126e-44af-a4a6-3b430a32e892 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:10.427704 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7d559fb9-126e-44af-a4a6-3b430a32e892 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:10.428290 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7d559fb9-126e-44af-a4a6-3b430a32e892 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:10.429131 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7d559fb9-126e-44af-a4a6-3b430a32e892 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:10.429598 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7d559fb9-126e-44af-a4a6-3b430a32e892 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:10.430032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7d559fb9-126e-44af-a4a6-3b430a32e892 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:10.572395 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-7d559fb9-126e-44af-a4a6-3b430a32e892 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:10.579898 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-7d559fb9-126e-44af-a4a6-3b430a32e892 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.164987 Aug 17 23:47:10.592063 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 259/515] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:10 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:10.946200 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-078dbe93-80c4-4891-904f-f7b86628f7d5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:10.946741 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-078dbe93-80c4-4891-904f-f7b86628f7d5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:10.952911 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-078dbe93-80c4-4891-904f-f7b86628f7d5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:10.953394 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-078dbe93-80c4-4891-904f-f7b86628f7d5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:10.953828 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-078dbe93-80c4-4891-904f-f7b86628f7d5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:10.954533 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-078dbe93-80c4-4891-904f-f7b86628f7d5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:10.954989 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-078dbe93-80c4-4891-904f-f7b86628f7d5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:10.955442 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-078dbe93-80c4-4891-904f-f7b86628f7d5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:11.098118 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-078dbe93-80c4-4891-904f-f7b86628f7d5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:11.101672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:47:11.107227 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-078dbe93-80c4-4891-904f-f7b86628f7d5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.165012 Aug 17 23:47:11.107811 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 257/516] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:10 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:11.416662 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-855e67b1-8c47-41b1-8489-ee0f0af54695 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:11.417274 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-855e67b1-8c47-41b1-8489-ee0f0af54695 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:11.423871 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-855e67b1-8c47-41b1-8489-ee0f0af54695 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:11.424510 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-855e67b1-8c47-41b1-8489-ee0f0af54695 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:11.424845 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-855e67b1-8c47-41b1-8489-ee0f0af54695 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:11.425551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-855e67b1-8c47-41b1-8489-ee0f0af54695 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:11.426006 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-855e67b1-8c47-41b1-8489-ee0f0af54695 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:11.426860 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-855e67b1-8c47-41b1-8489-ee0f0af54695 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:11.567057 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-855e67b1-8c47-41b1-8489-ee0f0af54695 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:11.575254 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-855e67b1-8c47-41b1-8489-ee0f0af54695 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.162359 Aug 17 23:47:11.575832 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 260/517] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:11 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:11.602613 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2f90b434-4e7b-413b-b5a8-d1799f97bba9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:11.603174 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2f90b434-4e7b-413b-b5a8-d1799f97bba9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:11.611610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2f90b434-4e7b-413b-b5a8-d1799f97bba9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:11.612222 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2f90b434-4e7b-413b-b5a8-d1799f97bba9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:11.612667 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2f90b434-4e7b-413b-b5a8-d1799f97bba9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:11.613603 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2f90b434-4e7b-413b-b5a8-d1799f97bba9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:11.614061 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2f90b434-4e7b-413b-b5a8-d1799f97bba9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:11.614484 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2f90b434-4e7b-413b-b5a8-d1799f97bba9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:11.773033 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2f90b434-4e7b-413b-b5a8-d1799f97bba9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:11.781115 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2f90b434-4e7b-413b-b5a8-d1799f97bba9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.182979 Aug 17 23:47:11.781981 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 258/518] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:11 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:12.128306 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-27b32e15-d857-4159-8ab2-0e896ff6364b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:12.128930 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-27b32e15-d857-4159-8ab2-0e896ff6364b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:12.135202 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-27b32e15-d857-4159-8ab2-0e896ff6364b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:12.135698 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-27b32e15-d857-4159-8ab2-0e896ff6364b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:12.135830 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5fb95bb7-9031-4c27-ac33-05d244a05d6b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1176833986", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1853072573", "security_groups": [{"name": "tempest-secgroup-smoke-774776606"}], "networks": [{"uuid": "f0618279-2e97-4142-95f8-f79731ec6218"}], "block_device_mapping_v2": [{"uuid": "3a1fe922-244a-4af0-9be3-7ee66b01250d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:47:12.136194 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-27b32e15-d857-4159-8ab2-0e896ff6364b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:12.136901 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-27b32e15-d857-4159-8ab2-0e896ff6364b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:12.137364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-27b32e15-d857-4159-8ab2-0e896ff6364b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:12.137826 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-27b32e15-d857-4159-8ab2-0e896ff6364b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:12.268681 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.network.neutron [None req-5fb95bb7-9031-4c27-ac33-05d244a05d6b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] validate_networks() for [('f0618279-2e97-4142-95f8-f79731ec6218', None, None, None, None, None)] {{(pid=131395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:47:12.298685 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-27b32e15-d857-4159-8ab2-0e896ff6364b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:12.306477 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-27b32e15-d857-4159-8ab2-0e896ff6364b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.181996 Aug 17 23:47:12.307195 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 261/519] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:12 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:12.597671 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f1f00fdf-de11-4ebe-b9c0-316bdc12a617 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:12.599376 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f1f00fdf-de11-4ebe-b9c0-316bdc12a617 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:12.606222 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f1f00fdf-de11-4ebe-b9c0-316bdc12a617 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:12.607616 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f1f00fdf-de11-4ebe-b9c0-316bdc12a617 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:12.608152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f1f00fdf-de11-4ebe-b9c0-316bdc12a617 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:12.609565 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f1f00fdf-de11-4ebe-b9c0-316bdc12a617 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:12.610105 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f1f00fdf-de11-4ebe-b9c0-316bdc12a617 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:12.611093 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f1f00fdf-de11-4ebe-b9c0-316bdc12a617 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:12.654846 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-5fb95bb7-9031-4c27-ac33-05d244a05d6b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Flavor limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:47:12.655268 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-5fb95bb7-9031-4c27-ac33-05d244a05d6b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Image limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:47:12.655744 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-5fb95bb7-9031-4c27-ac33-05d244a05d6b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Flavor pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:47:12.656278 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-5fb95bb7-9031-4c27-ac33-05d244a05d6b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Image pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:47:12.656597 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-5fb95bb7-9031-4c27-ac33-05d244a05d6b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:47:12.671478 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5fb95bb7-9031-4c27-ac33-05d244a05d6b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:12.672007 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5fb95bb7-9031-4c27-ac33-05d244a05d6b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:12.672441 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5fb95bb7-9031-4c27-ac33-05d244a05d6b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:12.673177 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5fb95bb7-9031-4c27-ac33-05d244a05d6b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:12.673640 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5fb95bb7-9031-4c27-ac33-05d244a05d6b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:12.674072 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5fb95bb7-9031-4c27-ac33-05d244a05d6b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:12.691520 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-5fb95bb7-9031-4c27-ac33-05d244a05d6b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Getting quotas for project aac208652b8247049fa6a0bc9aa991bf. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:47:12.696905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-5fb95bb7-9031-4c27-ac33-05d244a05d6b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Getting quotas for user ce1b5129d46345ef99c69e95f9824c45 and project aac208652b8247049fa6a0bc9aa991bf. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:47:12.761116 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5fb95bb7-9031-4c27-ac33-05d244a05d6b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Going to run 1 instances... {{(pid=131395) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:47:12.763380 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5fb95bb7-9031-4c27-ac33-05d244a05d6b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3a1fe922-244a-4af0-9be3-7ee66b01250d',volume_size=None,volume_type=None)] {{(pid=131395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:47:12.784816 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f1f00fdf-de11-4ebe-b9c0-316bdc12a617 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:12.793623 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f1f00fdf-de11-4ebe-b9c0-316bdc12a617 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.200436 Aug 17 23:47:12.794616 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 262/520] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:12 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:12.812783 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-14a2e251-1e22-4c20-b3c9-524f87045b7b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:12.813399 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-14a2e251-1e22-4c20-b3c9-524f87045b7b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:12.819400 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-14a2e251-1e22-4c20-b3c9-524f87045b7b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:12.819972 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-14a2e251-1e22-4c20-b3c9-524f87045b7b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:12.820509 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-14a2e251-1e22-4c20-b3c9-524f87045b7b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:12.821792 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-14a2e251-1e22-4c20-b3c9-524f87045b7b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:12.822259 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-14a2e251-1e22-4c20-b3c9-524f87045b7b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:12.822684 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-14a2e251-1e22-4c20-b3c9-524f87045b7b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:12.919733 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5fb95bb7-9031-4c27-ac33-05d244a05d6b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.787446 Aug 17 23:47:12.920603 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 259/521] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 17 23:47:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 23:47:12.932898 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a4d09abb-3302-47a2-aeca-79140435b54a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:12.934207 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a4d09abb-3302-47a2-aeca-79140435b54a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:12.979057 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-14a2e251-1e22-4c20-b3c9-524f87045b7b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:12.988004 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-14a2e251-1e22-4c20-b3c9-524f87045b7b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.179174 Aug 17 23:47:12.988912 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 263/522] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:12 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:13.013488 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a4d09abb-3302-47a2-aeca-79140435b54a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:13.021395 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a4d09abb-3302-47a2-aeca-79140435b54a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1089 microversion: 2.1 time: 0.092359 Aug 17 23:47:13.023266 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 260/523] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:12 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1089 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:13.333417 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c39bce5d-5df5-41b4-9aa0-a11e87edcd21 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:13.334286 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c39bce5d-5df5-41b4-9aa0-a11e87edcd21 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:13.341147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:47:13.343272 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c39bce5d-5df5-41b4-9aa0-a11e87edcd21 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:13.343931 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c39bce5d-5df5-41b4-9aa0-a11e87edcd21 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:13.344399 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c39bce5d-5df5-41b4-9aa0-a11e87edcd21 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:13.345097 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c39bce5d-5df5-41b4-9aa0-a11e87edcd21 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:13.345549 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c39bce5d-5df5-41b4-9aa0-a11e87edcd21 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:13.345971 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c39bce5d-5df5-41b4-9aa0-a11e87edcd21 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:13.494723 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c39bce5d-5df5-41b4-9aa0-a11e87edcd21 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:13.503138 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c39bce5d-5df5-41b4-9aa0-a11e87edcd21 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.173508 Aug 17 23:47:13.503713 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 264/524] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:13 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:13.816835 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c0ea51ef-9bf0-4abe-9f13-7dfff8fde085 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:13.817574 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c0ea51ef-9bf0-4abe-9f13-7dfff8fde085 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:13.824478 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0ea51ef-9bf0-4abe-9f13-7dfff8fde085 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:13.824965 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0ea51ef-9bf0-4abe-9f13-7dfff8fde085 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:13.825402 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0ea51ef-9bf0-4abe-9f13-7dfff8fde085 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:13.826092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0ea51ef-9bf0-4abe-9f13-7dfff8fde085 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:13.826546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0ea51ef-9bf0-4abe-9f13-7dfff8fde085 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:13.826998 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0ea51ef-9bf0-4abe-9f13-7dfff8fde085 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:13.959708 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c0ea51ef-9bf0-4abe-9f13-7dfff8fde085 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:13.968048 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c0ea51ef-9bf0-4abe-9f13-7dfff8fde085 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.155067 Aug 17 23:47:13.968635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 261/525] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:13 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:14.009559 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a5af773e-bd63-453c-a724-a136c37a1697 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:14.010290 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a5af773e-bd63-453c-a724-a136c37a1697 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:14.012507 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=6 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:47:14.013174 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=22 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:47:14.019129 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a5af773e-bd63-453c-a724-a136c37a1697 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:14.019616 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a5af773e-bd63-453c-a724-a136c37a1697 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:14.020091 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a5af773e-bd63-453c-a724-a136c37a1697 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:14.020790 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a5af773e-bd63-453c-a724-a136c37a1697 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:14.021247 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a5af773e-bd63-453c-a724-a136c37a1697 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:14.021674 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a5af773e-bd63-453c-a724-a136c37a1697 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:14.042890 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-de453045-cf04-466f-8ea8-61f178452a28 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:14.043502 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-de453045-cf04-466f-8ea8-61f178452a28 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:14.051998 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-de453045-cf04-466f-8ea8-61f178452a28 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:14.051998 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-de453045-cf04-466f-8ea8-61f178452a28 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:14.051998 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-de453045-cf04-466f-8ea8-61f178452a28 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:14.051998 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-de453045-cf04-466f-8ea8-61f178452a28 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:14.052475 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-de453045-cf04-466f-8ea8-61f178452a28 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:14.052475 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-de453045-cf04-466f-8ea8-61f178452a28 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:14.120121 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-de453045-cf04-466f-8ea8-61f178452a28 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:14.128161 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-de453045-cf04-466f-8ea8-61f178452a28 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1139 microversion: 2.1 time: 0.089557 Aug 17 23:47:14.129071 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 262/526] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:14 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:14.164228 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a5af773e-bd63-453c-a724-a136c37a1697 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:14.172587 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a5af773e-bd63-453c-a724-a136c37a1697 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.166980 Aug 17 23:47:14.173416 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 265/527] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:14 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:14.529503 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-8bf2d7ba-1543-41b9-8ace-bca2dd78f471 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:14.530130 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-8bf2d7ba-1543-41b9-8ace-bca2dd78f471 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:14.540479 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8bf2d7ba-1543-41b9-8ace-bca2dd78f471 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:14.541006 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8bf2d7ba-1543-41b9-8ace-bca2dd78f471 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:14.541458 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8bf2d7ba-1543-41b9-8ace-bca2dd78f471 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:14.547135 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8bf2d7ba-1543-41b9-8ace-bca2dd78f471 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:14.547623 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8bf2d7ba-1543-41b9-8ace-bca2dd78f471 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:14.548145 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8bf2d7ba-1543-41b9-8ace-bca2dd78f471 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:14.935649 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8bf2d7ba-1543-41b9-8ace-bca2dd78f471 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:14.943107 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-8bf2d7ba-1543-41b9-8ace-bca2dd78f471 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.422329 Aug 17 23:47:14.943674 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 263/528] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:14 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:14.990555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-3919e3a7-cef3-458b-98f9-f88dd35b03d6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:14.991166 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-3919e3a7-cef3-458b-98f9-f88dd35b03d6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:14.997717 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3919e3a7-cef3-458b-98f9-f88dd35b03d6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:14.998135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3919e3a7-cef3-458b-98f9-f88dd35b03d6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:14.998574 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3919e3a7-cef3-458b-98f9-f88dd35b03d6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:14.999267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3919e3a7-cef3-458b-98f9-f88dd35b03d6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:14.999746 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3919e3a7-cef3-458b-98f9-f88dd35b03d6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:15.000185 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3919e3a7-cef3-458b-98f9-f88dd35b03d6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:15.141333 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-3919e3a7-cef3-458b-98f9-f88dd35b03d6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:15.147377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3b3e4ca0-ea0c-460f-98cd-37e594ece130 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:15.148010 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3b3e4ca0-ea0c-460f-98cd-37e594ece130 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:15.148983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-3919e3a7-cef3-458b-98f9-f88dd35b03d6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.162231 Aug 17 23:47:15.149869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 266/529] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:14 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:15.154083 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b3e4ca0-ea0c-460f-98cd-37e594ece130 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:15.154571 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b3e4ca0-ea0c-460f-98cd-37e594ece130 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:15.155007 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b3e4ca0-ea0c-460f-98cd-37e594ece130 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:15.155703 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b3e4ca0-ea0c-460f-98cd-37e594ece130 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:15.156195 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b3e4ca0-ea0c-460f-98cd-37e594ece130 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:15.156618 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b3e4ca0-ea0c-460f-98cd-37e594ece130 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:15.193374 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-3639cd20-4b82-4974-ace7-f48fa14627eb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:15.193976 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-3639cd20-4b82-4974-ace7-f48fa14627eb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:15.200558 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3639cd20-4b82-4974-ace7-f48fa14627eb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:15.200839 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3639cd20-4b82-4974-ace7-f48fa14627eb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:15.201253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3639cd20-4b82-4974-ace7-f48fa14627eb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:15.201957 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3639cd20-4b82-4974-ace7-f48fa14627eb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:15.202409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3639cd20-4b82-4974-ace7-f48fa14627eb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:15.202835 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3639cd20-4b82-4974-ace7-f48fa14627eb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:15.205724 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=100 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:47:15.221791 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3b3e4ca0-ea0c-460f-98cd-37e594ece130 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:15.229983 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3b3e4ca0-ea0c-460f-98cd-37e594ece130 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1139 microversion: 2.1 time: 0.086310 Aug 17 23:47:15.236198 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 264/530] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:15 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1139 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:15.341797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-3639cd20-4b82-4974-ace7-f48fa14627eb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:15.349562 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-3639cd20-4b82-4974-ace7-f48fa14627eb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.159907 Aug 17 23:47:15.350142 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 267/531] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:15 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:15.642343 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b6ef2a01-fe52-42d7-919f-30926aca51dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:15.642840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b6ef2a01-fe52-42d7-919f-30926aca51dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:15.648896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b6ef2a01-fe52-42d7-919f-30926aca51dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:15.649887 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b6ef2a01-fe52-42d7-919f-30926aca51dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:15.650398 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b6ef2a01-fe52-42d7-919f-30926aca51dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:15.651193 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b6ef2a01-fe52-42d7-919f-30926aca51dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:15.651658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b6ef2a01-fe52-42d7-919f-30926aca51dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:15.652175 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b6ef2a01-fe52-42d7-919f-30926aca51dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:15.677089 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b6ef2a01-fe52-42d7-919f-30926aca51dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323/ips" status: 200 len: 151 microversion: 2.20 time: 0.038697 Aug 17 23:47:15.677840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 265/532] 10.222.0.26 () {60 vars in 1289 bytes} [Wed Aug 17 23:47:15 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 23:47:15.966722 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-3841e608-2285-4dda-966f-70e1cdca25c2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:15.967545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-3841e608-2285-4dda-966f-70e1cdca25c2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:15.975114 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3841e608-2285-4dda-966f-70e1cdca25c2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:15.976266 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3841e608-2285-4dda-966f-70e1cdca25c2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:15.976768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3841e608-2285-4dda-966f-70e1cdca25c2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:15.977863 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3841e608-2285-4dda-966f-70e1cdca25c2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:15.978430 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3841e608-2285-4dda-966f-70e1cdca25c2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:15.979160 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3841e608-2285-4dda-966f-70e1cdca25c2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:16.134688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-3841e608-2285-4dda-966f-70e1cdca25c2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:16.143161 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-3841e608-2285-4dda-966f-70e1cdca25c2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.181841 Aug 17 23:47:16.143813 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 268/533] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:15 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:16.170859 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-364207c0-599b-4903-b75d-e0e1eea7a665 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:16.171667 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-364207c0-599b-4903-b75d-e0e1eea7a665 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:16.178527 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-364207c0-599b-4903-b75d-e0e1eea7a665 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:16.179012 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-364207c0-599b-4903-b75d-e0e1eea7a665 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:16.179447 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-364207c0-599b-4903-b75d-e0e1eea7a665 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:16.180178 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-364207c0-599b-4903-b75d-e0e1eea7a665 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:16.181169 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-364207c0-599b-4903-b75d-e0e1eea7a665 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:16.181593 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-364207c0-599b-4903-b75d-e0e1eea7a665 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:16.256549 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a907ea2e-30d0-4eb6-bed4-7b8e499c3d80 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:16.257205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a907ea2e-30d0-4eb6-bed4-7b8e499c3d80 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:16.269280 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a907ea2e-30d0-4eb6-bed4-7b8e499c3d80 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:16.269780 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a907ea2e-30d0-4eb6-bed4-7b8e499c3d80 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:16.270228 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a907ea2e-30d0-4eb6-bed4-7b8e499c3d80 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:16.270959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a907ea2e-30d0-4eb6-bed4-7b8e499c3d80 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:16.271387 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a907ea2e-30d0-4eb6-bed4-7b8e499c3d80 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:16.271811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a907ea2e-30d0-4eb6-bed4-7b8e499c3d80 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:16.335124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-364207c0-599b-4903-b75d-e0e1eea7a665 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:16.335294 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a907ea2e-30d0-4eb6-bed4-7b8e499c3d80 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:16.343034 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-364207c0-599b-4903-b75d-e0e1eea7a665 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.176291 Aug 17 23:47:16.343383 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a907ea2e-30d0-4eb6-bed4-7b8e499c3d80 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1139 microversion: 2.1 time: 0.096832 Aug 17 23:47:16.357483 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 266/534] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:16 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:16.357690 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 269/535] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:16 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1139 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:16.371039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-382c07aa-5216-4bfc-8400-83d30218bb58 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:16.371641 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-382c07aa-5216-4bfc-8400-83d30218bb58 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:16.378001 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-382c07aa-5216-4bfc-8400-83d30218bb58 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:16.378478 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-382c07aa-5216-4bfc-8400-83d30218bb58 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:16.378910 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-382c07aa-5216-4bfc-8400-83d30218bb58 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:16.379592 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-382c07aa-5216-4bfc-8400-83d30218bb58 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:16.380142 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-382c07aa-5216-4bfc-8400-83d30218bb58 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:16.380490 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-382c07aa-5216-4bfc-8400-83d30218bb58 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:16.514878 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-382c07aa-5216-4bfc-8400-83d30218bb58 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:16.523050 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-382c07aa-5216-4bfc-8400-83d30218bb58 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.156251 Aug 17 23:47:16.523628 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 267/536] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:16 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:17.165888 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-2344da39-7807-4645-87a5-880d78ccbe64 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:17.166570 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-2344da39-7807-4645-87a5-880d78ccbe64 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:17.173210 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2344da39-7807-4645-87a5-880d78ccbe64 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:17.173697 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2344da39-7807-4645-87a5-880d78ccbe64 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:17.174134 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2344da39-7807-4645-87a5-880d78ccbe64 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:17.174889 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2344da39-7807-4645-87a5-880d78ccbe64 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:17.175350 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2344da39-7807-4645-87a5-880d78ccbe64 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:17.175818 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2344da39-7807-4645-87a5-880d78ccbe64 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:17.313779 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-2344da39-7807-4645-87a5-880d78ccbe64 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:17.321901 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-2344da39-7807-4645-87a5-880d78ccbe64 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.160301 Aug 17 23:47:17.322489 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 270/537] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:17 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:17.365057 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5673ecef-6c52-42e9-a6eb-1cfefd0e40ae tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:17.367166 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5673ecef-6c52-42e9-a6eb-1cfefd0e40ae tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:17.369812 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ce34d569-0052-4124-bab9-755bec38d23a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:17.370504 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ce34d569-0052-4124-bab9-755bec38d23a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:17.374438 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5673ecef-6c52-42e9-a6eb-1cfefd0e40ae tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:17.375201 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5673ecef-6c52-42e9-a6eb-1cfefd0e40ae tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:17.375713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5673ecef-6c52-42e9-a6eb-1cfefd0e40ae tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:17.376519 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5673ecef-6c52-42e9-a6eb-1cfefd0e40ae tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:17.376923 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce34d569-0052-4124-bab9-755bec38d23a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:17.377046 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5673ecef-6c52-42e9-a6eb-1cfefd0e40ae tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:17.377408 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce34d569-0052-4124-bab9-755bec38d23a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:17.377548 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5673ecef-6c52-42e9-a6eb-1cfefd0e40ae tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:17.377838 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce34d569-0052-4124-bab9-755bec38d23a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:17.378524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce34d569-0052-4124-bab9-755bec38d23a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:17.378972 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce34d569-0052-4124-bab9-755bec38d23a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:17.379386 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce34d569-0052-4124-bab9-755bec38d23a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:17.444759 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ce34d569-0052-4124-bab9-755bec38d23a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:17.453327 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ce34d569-0052-4124-bab9-755bec38d23a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1139 microversion: 2.1 time: 0.087228 Aug 17 23:47:17.453979 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 271/538] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:17 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:17.522652 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5673ecef-6c52-42e9-a6eb-1cfefd0e40ae tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:17.531369 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5673ecef-6c52-42e9-a6eb-1cfefd0e40ae tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.170430 Aug 17 23:47:17.531931 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 268/539] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:17 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:17.544494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-57f7cc0c-fbac-4b6d-8aa7-c8be4511dfe4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:17.545150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-57f7cc0c-fbac-4b6d-8aa7-c8be4511dfe4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:17.551442 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-57f7cc0c-fbac-4b6d-8aa7-c8be4511dfe4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:17.552109 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-57f7cc0c-fbac-4b6d-8aa7-c8be4511dfe4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:17.552639 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-57f7cc0c-fbac-4b6d-8aa7-c8be4511dfe4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:17.553347 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-57f7cc0c-fbac-4b6d-8aa7-c8be4511dfe4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:17.553805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-57f7cc0c-fbac-4b6d-8aa7-c8be4511dfe4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:17.554387 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-57f7cc0c-fbac-4b6d-8aa7-c8be4511dfe4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:17.689676 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-57f7cc0c-fbac-4b6d-8aa7-c8be4511dfe4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:17.698166 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-57f7cc0c-fbac-4b6d-8aa7-c8be4511dfe4 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.157511 Aug 17 23:47:17.698724 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 272/540] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:17 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:18.343891 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-d2b6aabc-cce5-421e-952d-619ef988daa5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:18.344450 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-d2b6aabc-cce5-421e-952d-619ef988daa5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:18.350451 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d2b6aabc-cce5-421e-952d-619ef988daa5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:18.350934 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d2b6aabc-cce5-421e-952d-619ef988daa5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:18.351371 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d2b6aabc-cce5-421e-952d-619ef988daa5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:18.352099 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d2b6aabc-cce5-421e-952d-619ef988daa5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:18.353065 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d2b6aabc-cce5-421e-952d-619ef988daa5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:18.353487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d2b6aabc-cce5-421e-952d-619ef988daa5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:18.473957 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-46dc2187-a405-4fb6-bbe1-3f57d93abd4e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:18.474576 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-46dc2187-a405-4fb6-bbe1-3f57d93abd4e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:18.482195 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-46dc2187-a405-4fb6-bbe1-3f57d93abd4e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:18.482684 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-46dc2187-a405-4fb6-bbe1-3f57d93abd4e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:18.483121 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-46dc2187-a405-4fb6-bbe1-3f57d93abd4e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:18.483826 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-46dc2187-a405-4fb6-bbe1-3f57d93abd4e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:18.484316 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-46dc2187-a405-4fb6-bbe1-3f57d93abd4e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:18.484742 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-46dc2187-a405-4fb6-bbe1-3f57d93abd4e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:18.496680 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d2b6aabc-cce5-421e-952d-619ef988daa5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:18.507024 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-d2b6aabc-cce5-421e-952d-619ef988daa5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.166886 Aug 17 23:47:18.508067 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 269/541] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:18 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:18.551347 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-46dc2187-a405-4fb6-bbe1-3f57d93abd4e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:18.553166 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-270f0a85-b045-4cec-bf7c-32ed9932a50d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:18.553885 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-270f0a85-b045-4cec-bf7c-32ed9932a50d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:18.559250 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-46dc2187-a405-4fb6-bbe1-3f57d93abd4e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1139 microversion: 2.1 time: 0.089089 Aug 17 23:47:18.559895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-270f0a85-b045-4cec-bf7c-32ed9932a50d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:18.560150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 273/542] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:18 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:18.560563 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-270f0a85-b045-4cec-bf7c-32ed9932a50d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:18.561087 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-270f0a85-b045-4cec-bf7c-32ed9932a50d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:18.561865 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-270f0a85-b045-4cec-bf7c-32ed9932a50d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:18.562333 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-270f0a85-b045-4cec-bf7c-32ed9932a50d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:18.562766 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-270f0a85-b045-4cec-bf7c-32ed9932a50d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:18.641539 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b87f83b2-f9c9-4423-bab3-c54a7e1caff3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:47:18.642140 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b87f83b2-f9c9-4423-bab3-c54a7e1caff3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:18.648907 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b87f83b2-f9c9-4423-bab3-c54a7e1caff3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:18.649950 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b87f83b2-f9c9-4423-bab3-c54a7e1caff3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:18.650378 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b87f83b2-f9c9-4423-bab3-c54a7e1caff3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:18.651082 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b87f83b2-f9c9-4423-bab3-c54a7e1caff3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:18.651592 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b87f83b2-f9c9-4423-bab3-c54a7e1caff3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:18.651976 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b87f83b2-f9c9-4423-bab3-c54a7e1caff3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:18.675999 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.objects.instance [None req-b87f83b2-f9c9-4423-bab3-c54a7e1caff3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lazy-loading 'flavor' on Instance uuid abc34597-7782-4715-86c3-6a940ecde323 {{(pid=131394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:47:18.700922 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-270f0a85-b045-4cec-bf7c-32ed9932a50d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:18.708859 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-270f0a85-b045-4cec-bf7c-32ed9932a50d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.159495 Aug 17 23:47:18.709429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 270/543] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:18 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:18.721542 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-be656d81-2eaf-42ae-ad81-3aa4f7684edc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:18.722421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-be656d81-2eaf-42ae-ad81-3aa4f7684edc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:18.728394 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:47:18.730196 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-be656d81-2eaf-42ae-ad81-3aa4f7684edc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:18.730688 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-be656d81-2eaf-42ae-ad81-3aa4f7684edc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:18.731874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-be656d81-2eaf-42ae-ad81-3aa4f7684edc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:18.732664 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-be656d81-2eaf-42ae-ad81-3aa4f7684edc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:18.733596 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-be656d81-2eaf-42ae-ad81-3aa4f7684edc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:18.734012 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-be656d81-2eaf-42ae-ad81-3aa4f7684edc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:18.863317 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b87f83b2-f9c9-4423-bab3-c54a7e1caff3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "POST /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323/action" status: 202 len: 0 microversion: 2.20 time: 0.226948 Aug 17 23:47:18.863915 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 274/544] 10.222.0.26 () {62 vars in 1319 bytes} [Wed Aug 17 23:47:18 2022] POST /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 17 23:47:18.872403 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-de1b1c4c-08b5-4026-9424-e338380320be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:18.873121 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-de1b1c4c-08b5-4026-9424-e338380320be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:18.879214 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de1b1c4c-08b5-4026-9424-e338380320be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:18.879707 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de1b1c4c-08b5-4026-9424-e338380320be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:18.879908 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-be656d81-2eaf-42ae-ad81-3aa4f7684edc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:18.880200 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de1b1c4c-08b5-4026-9424-e338380320be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:18.880901 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de1b1c4c-08b5-4026-9424-e338380320be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:18.881362 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de1b1c4c-08b5-4026-9424-e338380320be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:18.881790 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de1b1c4c-08b5-4026-9424-e338380320be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:18.887917 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-be656d81-2eaf-42ae-ad81-3aa4f7684edc tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.172568 Aug 17 23:47:18.888516 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 271/545] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:18 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:19.019736 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-de1b1c4c-08b5-4026-9424-e338380320be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:19.029129 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-de1b1c4c-08b5-4026-9424-e338380320be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:19.030632 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-de1b1c4c-08b5-4026-9424-e338380320be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:19.031824 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-de1b1c4c-08b5-4026-9424-e338380320be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.163571 Aug 17 23:47:19.032436 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 275/546] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:18 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:47:19.533301 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1596e335-f5ed-4c79-b0c6-fc28bc9e73ca tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:19.534524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-1596e335-f5ed-4c79-b0c6-fc28bc9e73ca tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:19.541661 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1596e335-f5ed-4c79-b0c6-fc28bc9e73ca tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:19.542144 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1596e335-f5ed-4c79-b0c6-fc28bc9e73ca tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:19.542574 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1596e335-f5ed-4c79-b0c6-fc28bc9e73ca tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:19.543259 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1596e335-f5ed-4c79-b0c6-fc28bc9e73ca tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:19.543710 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1596e335-f5ed-4c79-b0c6-fc28bc9e73ca tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:19.544160 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1596e335-f5ed-4c79-b0c6-fc28bc9e73ca tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:19.580165 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-7ac2ef8b-e20d-4eaa-a1b5-ed52102d8dfd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:19.580775 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-7ac2ef8b-e20d-4eaa-a1b5-ed52102d8dfd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:19.587166 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7ac2ef8b-e20d-4eaa-a1b5-ed52102d8dfd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:19.587644 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7ac2ef8b-e20d-4eaa-a1b5-ed52102d8dfd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:19.588119 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7ac2ef8b-e20d-4eaa-a1b5-ed52102d8dfd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:19.588805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7ac2ef8b-e20d-4eaa-a1b5-ed52102d8dfd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:19.589253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7ac2ef8b-e20d-4eaa-a1b5-ed52102d8dfd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:19.589671 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7ac2ef8b-e20d-4eaa-a1b5-ed52102d8dfd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:19.650301 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-7ac2ef8b-e20d-4eaa-a1b5-ed52102d8dfd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:19.658075 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-7ac2ef8b-e20d-4eaa-a1b5-ed52102d8dfd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1139 microversion: 2.1 time: 0.081793 Aug 17 23:47:19.658649 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 276/547] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:19 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:19.670978 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1596e335-f5ed-4c79-b0c6-fc28bc9e73ca tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:19.678437 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-1596e335-f5ed-4c79-b0c6-fc28bc9e73ca tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.149406 Aug 17 23:47:19.678991 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 272/548] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:19 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:19.730676 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a3d8d2de-b53f-4867-b44d-f6b3705823c8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:19.731294 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a3d8d2de-b53f-4867-b44d-f6b3705823c8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:19.738295 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3d8d2de-b53f-4867-b44d-f6b3705823c8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:19.738816 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3d8d2de-b53f-4867-b44d-f6b3705823c8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:19.739260 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3d8d2de-b53f-4867-b44d-f6b3705823c8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:19.739949 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3d8d2de-b53f-4867-b44d-f6b3705823c8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:19.740430 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3d8d2de-b53f-4867-b44d-f6b3705823c8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:19.740858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a3d8d2de-b53f-4867-b44d-f6b3705823c8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:19.870141 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a3d8d2de-b53f-4867-b44d-f6b3705823c8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:19.877610 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a3d8d2de-b53f-4867-b44d-f6b3705823c8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.151264 Aug 17 23:47:19.878170 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 277/549] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:19 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:19.910319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b0ec85cc-0711-4295-bf95-35fffa81d158 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:19.910939 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b0ec85cc-0711-4295-bf95-35fffa81d158 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:19.917709 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b0ec85cc-0711-4295-bf95-35fffa81d158 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:19.918194 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b0ec85cc-0711-4295-bf95-35fffa81d158 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:19.918637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b0ec85cc-0711-4295-bf95-35fffa81d158 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:19.919329 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b0ec85cc-0711-4295-bf95-35fffa81d158 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:19.919792 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b0ec85cc-0711-4295-bf95-35fffa81d158 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:19.920244 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b0ec85cc-0711-4295-bf95-35fffa81d158 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:20.049135 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b0ec85cc-0711-4295-bf95-35fffa81d158 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:20.055109 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-bcf7fd64-e6bb-400f-8f53-bc0cffa65819 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:20.055714 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-bcf7fd64-e6bb-400f-8f53-bc0cffa65819 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:20.056643 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b0ec85cc-0711-4295-bf95-35fffa81d158 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.150101 Aug 17 23:47:20.057363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 273/550] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:19 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:20.061560 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bcf7fd64-e6bb-400f-8f53-bc0cffa65819 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:20.062051 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bcf7fd64-e6bb-400f-8f53-bc0cffa65819 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:20.062476 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bcf7fd64-e6bb-400f-8f53-bc0cffa65819 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:20.063156 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bcf7fd64-e6bb-400f-8f53-bc0cffa65819 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:20.063606 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bcf7fd64-e6bb-400f-8f53-bc0cffa65819 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:20.064045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bcf7fd64-e6bb-400f-8f53-bc0cffa65819 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:20.194429 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-bcf7fd64-e6bb-400f-8f53-bc0cffa65819 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:20.202268 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-bcf7fd64-e6bb-400f-8f53-bc0cffa65819 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:20.203762 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-bcf7fd64-e6bb-400f-8f53-bc0cffa65819 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:20.204938 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-bcf7fd64-e6bb-400f-8f53-bc0cffa65819 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.153712 Aug 17 23:47:20.205498 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 278/551] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:20 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:47:20.678559 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-91388d57-3b75-4753-9922-e07f2756eace tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:20.679092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-91388d57-3b75-4753-9922-e07f2756eace tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:20.685492 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-91388d57-3b75-4753-9922-e07f2756eace tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:20.685975 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-91388d57-3b75-4753-9922-e07f2756eace tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:20.686408 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-91388d57-3b75-4753-9922-e07f2756eace tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:20.687094 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-91388d57-3b75-4753-9922-e07f2756eace tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:20.687548 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-91388d57-3b75-4753-9922-e07f2756eace tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:20.687990 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-91388d57-3b75-4753-9922-e07f2756eace tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:20.698345 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-02440057-c5ff-4e3b-8c68-d6be65e4bf53 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:20.698952 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-02440057-c5ff-4e3b-8c68-d6be65e4bf53 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:20.705612 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-02440057-c5ff-4e3b-8c68-d6be65e4bf53 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:20.706165 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-02440057-c5ff-4e3b-8c68-d6be65e4bf53 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:20.706604 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-02440057-c5ff-4e3b-8c68-d6be65e4bf53 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:20.707286 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-02440057-c5ff-4e3b-8c68-d6be65e4bf53 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:20.707734 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-02440057-c5ff-4e3b-8c68-d6be65e4bf53 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:20.708178 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-02440057-c5ff-4e3b-8c68-d6be65e4bf53 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:20.748234 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-91388d57-3b75-4753-9922-e07f2756eace tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:20.756405 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-91388d57-3b75-4753-9922-e07f2756eace tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1139 microversion: 2.1 time: 0.081618 Aug 17 23:47:20.756989 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 274/552] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:20 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:20.837381 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-02440057-c5ff-4e3b-8c68-d6be65e4bf53 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:20.844726 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-02440057-c5ff-4e3b-8c68-d6be65e4bf53 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.150149 Aug 17 23:47:20.845311 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 279/553] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:20 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:20.898051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-cb4dffa7-dd3b-40ba-8247-d817f7b59b55 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:20.898658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-cb4dffa7-dd3b-40ba-8247-d817f7b59b55 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:20.905034 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cb4dffa7-dd3b-40ba-8247-d817f7b59b55 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:20.905517 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cb4dffa7-dd3b-40ba-8247-d817f7b59b55 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:20.905955 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cb4dffa7-dd3b-40ba-8247-d817f7b59b55 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:20.906640 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cb4dffa7-dd3b-40ba-8247-d817f7b59b55 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:20.907096 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cb4dffa7-dd3b-40ba-8247-d817f7b59b55 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:20.907520 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cb4dffa7-dd3b-40ba-8247-d817f7b59b55 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:21.035316 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-cb4dffa7-dd3b-40ba-8247-d817f7b59b55 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:21.043060 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-cb4dffa7-dd3b-40ba-8247-d817f7b59b55 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.148809 Aug 17 23:47:21.043627 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 275/554] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:20 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:21.077678 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e6608532-6dbf-4ed1-b0b4-e43061b1bbbb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:21.078303 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e6608532-6dbf-4ed1-b0b4-e43061b1bbbb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:21.084186 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e6608532-6dbf-4ed1-b0b4-e43061b1bbbb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:21.084672 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e6608532-6dbf-4ed1-b0b4-e43061b1bbbb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:21.085116 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e6608532-6dbf-4ed1-b0b4-e43061b1bbbb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:21.085807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e6608532-6dbf-4ed1-b0b4-e43061b1bbbb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:21.086263 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e6608532-6dbf-4ed1-b0b4-e43061b1bbbb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:21.087308 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e6608532-6dbf-4ed1-b0b4-e43061b1bbbb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:21.210990 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e6608532-6dbf-4ed1-b0b4-e43061b1bbbb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:21.218994 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e6608532-6dbf-4ed1-b0b4-e43061b1bbbb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.145107 Aug 17 23:47:21.219550 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 280/555] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:21 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:21.227338 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-22072f49-f746-4809-a6b7-fa13a2a84f33 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:21.227945 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-22072f49-f746-4809-a6b7-fa13a2a84f33 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:21.233843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22072f49-f746-4809-a6b7-fa13a2a84f33 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:21.234262 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22072f49-f746-4809-a6b7-fa13a2a84f33 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:21.234692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22072f49-f746-4809-a6b7-fa13a2a84f33 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:21.235373 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22072f49-f746-4809-a6b7-fa13a2a84f33 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:21.235823 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22072f49-f746-4809-a6b7-fa13a2a84f33 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:21.236277 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22072f49-f746-4809-a6b7-fa13a2a84f33 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:21.253736 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=100 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:47:21.367592 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-22072f49-f746-4809-a6b7-fa13a2a84f33 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:21.375490 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-22072f49-f746-4809-a6b7-fa13a2a84f33 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:21.377020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-22072f49-f746-4809-a6b7-fa13a2a84f33 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:21.378174 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-22072f49-f746-4809-a6b7-fa13a2a84f33 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.154774 Aug 17 23:47:21.378725 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 276/556] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:21 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:21.776564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-81aa46b6-0e9f-419a-9f72-b07e5836f02c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:21.777177 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-81aa46b6-0e9f-419a-9f72-b07e5836f02c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:21.783601 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-81aa46b6-0e9f-419a-9f72-b07e5836f02c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:21.784113 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-81aa46b6-0e9f-419a-9f72-b07e5836f02c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:21.784552 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-81aa46b6-0e9f-419a-9f72-b07e5836f02c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:21.785232 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-81aa46b6-0e9f-419a-9f72-b07e5836f02c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:21.785689 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-81aa46b6-0e9f-419a-9f72-b07e5836f02c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:21.786370 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-81aa46b6-0e9f-419a-9f72-b07e5836f02c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:21.848631 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-81aa46b6-0e9f-419a-9f72-b07e5836f02c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:21.850892 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:47:21.857747 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-81aa46b6-0e9f-419a-9f72-b07e5836f02c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1139 microversion: 2.1 time: 0.085012 Aug 17 23:47:21.858303 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 281/557] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:21 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:21.865688 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e9b0c9aa-9c07-42d1-b2e0-8f0dcc516784 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:21.866400 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e9b0c9aa-9c07-42d1-b2e0-8f0dcc516784 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:21.873590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e9b0c9aa-9c07-42d1-b2e0-8f0dcc516784 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:21.874074 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e9b0c9aa-9c07-42d1-b2e0-8f0dcc516784 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:21.874532 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e9b0c9aa-9c07-42d1-b2e0-8f0dcc516784 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:21.875202 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e9b0c9aa-9c07-42d1-b2e0-8f0dcc516784 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:21.875659 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e9b0c9aa-9c07-42d1-b2e0-8f0dcc516784 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:21.876115 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e9b0c9aa-9c07-42d1-b2e0-8f0dcc516784 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:22.001417 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e9b0c9aa-9c07-42d1-b2e0-8f0dcc516784 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:22.008927 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e9b0c9aa-9c07-42d1-b2e0-8f0dcc516784 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.147025 Aug 17 23:47:22.009492 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 277/558] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:21 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:22.063503 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9f84a8ec-cb02-4a57-aaa1-364b5aa779df tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:22.064068 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9f84a8ec-cb02-4a57-aaa1-364b5aa779df tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:22.071613 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f84a8ec-cb02-4a57-aaa1-364b5aa779df tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:22.072122 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f84a8ec-cb02-4a57-aaa1-364b5aa779df tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:22.072565 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f84a8ec-cb02-4a57-aaa1-364b5aa779df tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:22.073260 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f84a8ec-cb02-4a57-aaa1-364b5aa779df tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:22.073720 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f84a8ec-cb02-4a57-aaa1-364b5aa779df tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:22.074148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f84a8ec-cb02-4a57-aaa1-364b5aa779df tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:22.202169 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9f84a8ec-cb02-4a57-aaa1-364b5aa779df tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:22.209461 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9f84a8ec-cb02-4a57-aaa1-364b5aa779df tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.149894 Aug 17 23:47:22.210021 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 282/559] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:22 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:22.239824 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-91c9d5cd-eb43-4b4a-bdb0-b3e94a5a6034 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:22.240468 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-91c9d5cd-eb43-4b4a-bdb0-b3e94a5a6034 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:22.246293 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-91c9d5cd-eb43-4b4a-bdb0-b3e94a5a6034 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:22.246780 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-91c9d5cd-eb43-4b4a-bdb0-b3e94a5a6034 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:22.247213 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-91c9d5cd-eb43-4b4a-bdb0-b3e94a5a6034 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:22.247898 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-91c9d5cd-eb43-4b4a-bdb0-b3e94a5a6034 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:22.248379 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-91c9d5cd-eb43-4b4a-bdb0-b3e94a5a6034 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:22.248798 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-91c9d5cd-eb43-4b4a-bdb0-b3e94a5a6034 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:22.375793 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-91c9d5cd-eb43-4b4a-bdb0-b3e94a5a6034 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:22.383213 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-91c9d5cd-eb43-4b4a-bdb0-b3e94a5a6034 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.147175 Aug 17 23:47:22.383773 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 278/560] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:22 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:22.401718 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b0f87899-7ab9-4d4d-908f-03be40e72cd4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:22.402335 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b0f87899-7ab9-4d4d-908f-03be40e72cd4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:22.408162 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b0f87899-7ab9-4d4d-908f-03be40e72cd4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:22.408646 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b0f87899-7ab9-4d4d-908f-03be40e72cd4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:22.409080 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b0f87899-7ab9-4d4d-908f-03be40e72cd4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:22.409764 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b0f87899-7ab9-4d4d-908f-03be40e72cd4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:22.410221 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b0f87899-7ab9-4d4d-908f-03be40e72cd4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:22.410648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b0f87899-7ab9-4d4d-908f-03be40e72cd4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:22.538824 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b0f87899-7ab9-4d4d-908f-03be40e72cd4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:22.546906 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b0f87899-7ab9-4d4d-908f-03be40e72cd4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:22.548449 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b0f87899-7ab9-4d4d-908f-03be40e72cd4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:22.549620 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b0f87899-7ab9-4d4d-908f-03be40e72cd4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.152418 Aug 17 23:47:22.550209 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 283/561] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:22 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:22.878775 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b44aeeac-11be-4d18-81a9-4c62dff1acee tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:22.879290 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b44aeeac-11be-4d18-81a9-4c62dff1acee tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:22.881190 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:47:22.887302 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b44aeeac-11be-4d18-81a9-4c62dff1acee tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:22.887781 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b44aeeac-11be-4d18-81a9-4c62dff1acee tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:22.888231 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b44aeeac-11be-4d18-81a9-4c62dff1acee tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:22.888925 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b44aeeac-11be-4d18-81a9-4c62dff1acee tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:22.889371 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b44aeeac-11be-4d18-81a9-4c62dff1acee tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:22.889787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b44aeeac-11be-4d18-81a9-4c62dff1acee tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:22.960241 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b44aeeac-11be-4d18-81a9-4c62dff1acee tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:22.967869 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b44aeeac-11be-4d18-81a9-4c62dff1acee tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1131 microversion: 2.1 time: 0.093044 Aug 17 23:47:22.968498 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 279/562] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:22 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1131 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:23.029956 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a1b05553-9437-4812-b688-bb6324095eed tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:23.030637 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a1b05553-9437-4812-b688-bb6324095eed tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:23.037744 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1b05553-9437-4812-b688-bb6324095eed tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:23.038328 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1b05553-9437-4812-b688-bb6324095eed tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:23.038758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1b05553-9437-4812-b688-bb6324095eed tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:23.039452 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1b05553-9437-4812-b688-bb6324095eed tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:23.039979 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1b05553-9437-4812-b688-bb6324095eed tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:23.040432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1b05553-9437-4812-b688-bb6324095eed tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:23.151135 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-0131b45b-b8ef-4e4f-8d3b-cba39b86a67c req-483fdfc4-75b1-4654-afeb-4b6fefad0eeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930c290f-5bb3-44fe-857d-9d5423eca017", "tag": "e95c1c30-368b-4623-86e2-0d608e9a186a"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:47:23.159928 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=18 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:47:23.162061 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-0131b45b-b8ef-4e4f-8d3b-cba39b86a67c req-483fdfc4-75b1-4654-afeb-4b6fefad0eeb service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:23.162535 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-0131b45b-b8ef-4e4f-8d3b-cba39b86a67c req-483fdfc4-75b1-4654-afeb-4b6fefad0eeb service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:23.162960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-0131b45b-b8ef-4e4f-8d3b-cba39b86a67c req-483fdfc4-75b1-4654-afeb-4b6fefad0eeb service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:23.175727 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-0131b45b-b8ef-4e4f-8d3b-cba39b86a67c req-483fdfc4-75b1-4654-afeb-4b6fefad0eeb service nova] Creating event network-changed:e95c1c30-368b-4623-86e2-0d608e9a186a for instance 930c290f-5bb3-44fe-857d-9d5423eca017 on hv-cinder-82002 Aug 17 23:47:23.181287 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-0131b45b-b8ef-4e4f-8d3b-cba39b86a67c req-483fdfc4-75b1-4654-afeb-4b6fefad0eeb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034363 Aug 17 23:47:23.182052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 280/563] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:47:23.185113 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a1b05553-9437-4812-b688-bb6324095eed tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:23.192592 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a1b05553-9437-4812-b688-bb6324095eed tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.166537 Aug 17 23:47:23.193163 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 284/564] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:23 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:23.230831 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-72a6978e-4350-44e1-9a01-478268634448 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:23.231523 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-72a6978e-4350-44e1-9a01-478268634448 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:23.237661 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-72a6978e-4350-44e1-9a01-478268634448 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:23.238137 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-72a6978e-4350-44e1-9a01-478268634448 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:23.238569 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-72a6978e-4350-44e1-9a01-478268634448 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:23.239246 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-72a6978e-4350-44e1-9a01-478268634448 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:23.239693 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-72a6978e-4350-44e1-9a01-478268634448 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:23.240146 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-72a6978e-4350-44e1-9a01-478268634448 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:23.375595 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-72a6978e-4350-44e1-9a01-478268634448 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:23.383843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-72a6978e-4350-44e1-9a01-478268634448 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.157112 Aug 17 23:47:23.384379 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 281/565] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:23 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:23.403386 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b5869cfd-738a-430a-a815-361837810afb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:23.404017 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b5869cfd-738a-430a-a815-361837810afb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:23.409890 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b5869cfd-738a-430a-a815-361837810afb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:23.410369 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b5869cfd-738a-430a-a815-361837810afb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:23.410821 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b5869cfd-738a-430a-a815-361837810afb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:23.411754 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b5869cfd-738a-430a-a815-361837810afb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:23.412236 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b5869cfd-738a-430a-a815-361837810afb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:23.412665 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b5869cfd-738a-430a-a815-361837810afb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:23.539395 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b5869cfd-738a-430a-a815-361837810afb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:23.547342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b5869cfd-738a-430a-a815-361837810afb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.147854 Aug 17 23:47:23.547901 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 285/566] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:23 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:23.572646 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5602f438-17cb-48af-ae84-e29ae0801d15 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:23.573257 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5602f438-17cb-48af-ae84-e29ae0801d15 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:23.579233 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5602f438-17cb-48af-ae84-e29ae0801d15 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:23.579709 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5602f438-17cb-48af-ae84-e29ae0801d15 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:23.580179 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5602f438-17cb-48af-ae84-e29ae0801d15 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:23.580862 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5602f438-17cb-48af-ae84-e29ae0801d15 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:23.581344 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5602f438-17cb-48af-ae84-e29ae0801d15 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:23.581761 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5602f438-17cb-48af-ae84-e29ae0801d15 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:23.706938 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5602f438-17cb-48af-ae84-e29ae0801d15 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:23.715302 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5602f438-17cb-48af-ae84-e29ae0801d15 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:23.716815 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5602f438-17cb-48af-ae84-e29ae0801d15 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:23.717960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5602f438-17cb-48af-ae84-e29ae0801d15 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.149262 Aug 17 23:47:23.718512 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 282/567] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:23 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:23.988354 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c5bf9aa5-e294-4715-9e01-6fabd052f5ee tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:23.988965 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c5bf9aa5-e294-4715-9e01-6fabd052f5ee tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:23.994885 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5bf9aa5-e294-4715-9e01-6fabd052f5ee tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:23.995361 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5bf9aa5-e294-4715-9e01-6fabd052f5ee tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:23.995791 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5bf9aa5-e294-4715-9e01-6fabd052f5ee tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:23.996492 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5bf9aa5-e294-4715-9e01-6fabd052f5ee tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:23.996942 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5bf9aa5-e294-4715-9e01-6fabd052f5ee tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:23.997412 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5bf9aa5-e294-4715-9e01-6fabd052f5ee tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:24.062367 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c5bf9aa5-e294-4715-9e01-6fabd052f5ee tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:24.069796 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c5bf9aa5-e294-4715-9e01-6fabd052f5ee tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1131 microversion: 2.1 time: 0.085245 Aug 17 23:47:24.070353 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 286/568] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:23 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1131 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:24.218715 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e867c7f9-90ff-4b5b-a580-74ebddb0d624 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:24.219854 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e867c7f9-90ff-4b5b-a580-74ebddb0d624 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:24.231028 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e867c7f9-90ff-4b5b-a580-74ebddb0d624 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:24.232401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e867c7f9-90ff-4b5b-a580-74ebddb0d624 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:24.232855 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e867c7f9-90ff-4b5b-a580-74ebddb0d624 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:24.233706 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e867c7f9-90ff-4b5b-a580-74ebddb0d624 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:24.234181 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e867c7f9-90ff-4b5b-a580-74ebddb0d624 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:24.234704 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e867c7f9-90ff-4b5b-a580-74ebddb0d624 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:24.405098 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9cb06406-2f5d-4699-9c7b-181adcb685e7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:24.405713 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9cb06406-2f5d-4699-9c7b-181adcb685e7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:24.411868 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9cb06406-2f5d-4699-9c7b-181adcb685e7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:24.412418 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9cb06406-2f5d-4699-9c7b-181adcb685e7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:24.412825 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9cb06406-2f5d-4699-9c7b-181adcb685e7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:24.413527 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9cb06406-2f5d-4699-9c7b-181adcb685e7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:24.413985 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9cb06406-2f5d-4699-9c7b-181adcb685e7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:24.414691 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9cb06406-2f5d-4699-9c7b-181adcb685e7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:24.545819 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e867c7f9-90ff-4b5b-a580-74ebddb0d624 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:24.553640 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e867c7f9-90ff-4b5b-a580-74ebddb0d624 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.343078 Aug 17 23:47:24.554216 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 283/569] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:24 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:24.557544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9cb06406-2f5d-4699-9c7b-181adcb685e7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:24.565509 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9cb06406-2f5d-4699-9c7b-181adcb685e7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.164419 Aug 17 23:47:24.566437 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 287/570] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:24 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:24.568245 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-580efa42-c35a-4f4c-a9b2-b979dda54599 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:24.568944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-580efa42-c35a-4f4c-a9b2-b979dda54599 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:24.576275 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-580efa42-c35a-4f4c-a9b2-b979dda54599 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:24.576874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-580efa42-c35a-4f4c-a9b2-b979dda54599 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:24.577508 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-580efa42-c35a-4f4c-a9b2-b979dda54599 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:24.578165 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-580efa42-c35a-4f4c-a9b2-b979dda54599 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:24.578850 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-580efa42-c35a-4f4c-a9b2-b979dda54599 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:24.579629 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-580efa42-c35a-4f4c-a9b2-b979dda54599 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:24.741611 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-7988123d-ccb9-4a88-9e0c-1cd656eb4382 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:24.742465 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-7988123d-ccb9-4a88-9e0c-1cd656eb4382 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:24.749010 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7988123d-ccb9-4a88-9e0c-1cd656eb4382 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:24.749427 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7988123d-ccb9-4a88-9e0c-1cd656eb4382 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:24.750039 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7988123d-ccb9-4a88-9e0c-1cd656eb4382 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:24.750894 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7988123d-ccb9-4a88-9e0c-1cd656eb4382 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:24.751502 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7988123d-ccb9-4a88-9e0c-1cd656eb4382 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:24.752292 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7988123d-ccb9-4a88-9e0c-1cd656eb4382 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:24.848960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-580efa42-c35a-4f4c-a9b2-b979dda54599 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:24.858350 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-580efa42-c35a-4f4c-a9b2-b979dda54599 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.294009 Aug 17 23:47:24.859022 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 284/571] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:24 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:24.883813 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-7988123d-ccb9-4a88-9e0c-1cd656eb4382 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:24.891665 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-7988123d-ccb9-4a88-9e0c-1cd656eb4382 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:24.893239 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-7988123d-ccb9-4a88-9e0c-1cd656eb4382 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:24.894391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-7988123d-ccb9-4a88-9e0c-1cd656eb4382 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.156983 Aug 17 23:47:24.894951 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 288/572] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:24 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:47:25.091197 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-193cb544-e316-4039-ab8d-59cca4c761c1 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:25.092042 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-193cb544-e316-4039-ab8d-59cca4c761c1 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:25.098755 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-193cb544-e316-4039-ab8d-59cca4c761c1 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:25.099251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-193cb544-e316-4039-ab8d-59cca4c761c1 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:25.099683 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-193cb544-e316-4039-ab8d-59cca4c761c1 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:25.101743 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-193cb544-e316-4039-ab8d-59cca4c761c1 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:25.101743 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-193cb544-e316-4039-ab8d-59cca4c761c1 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:25.101743 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-193cb544-e316-4039-ab8d-59cca4c761c1 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:25.182972 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-193cb544-e316-4039-ab8d-59cca4c761c1 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:25.190415 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-193cb544-e316-4039-ab8d-59cca4c761c1 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1205 microversion: 2.1 time: 0.103206 Aug 17 23:47:25.190977 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 285/573] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:25 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1205 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:25.574672 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d0cf1b55-c9e1-42fd-8e6f-a5e993dc58da tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:25.575283 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d0cf1b55-c9e1-42fd-8e6f-a5e993dc58da tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:25.581911 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d0cf1b55-c9e1-42fd-8e6f-a5e993dc58da tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:25.582380 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d0cf1b55-c9e1-42fd-8e6f-a5e993dc58da tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:25.582823 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d0cf1b55-c9e1-42fd-8e6f-a5e993dc58da tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:25.583503 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d0cf1b55-c9e1-42fd-8e6f-a5e993dc58da tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:25.583949 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d0cf1b55-c9e1-42fd-8e6f-a5e993dc58da tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:25.584389 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d0cf1b55-c9e1-42fd-8e6f-a5e993dc58da tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:25.586442 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-33356736-0456-405b-b911-6a8222250ef8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:25.587067 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-33356736-0456-405b-b911-6a8222250ef8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:25.593341 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-33356736-0456-405b-b911-6a8222250ef8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:25.593828 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-33356736-0456-405b-b911-6a8222250ef8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:25.594268 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-33356736-0456-405b-b911-6a8222250ef8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:25.594968 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-33356736-0456-405b-b911-6a8222250ef8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:25.595430 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-33356736-0456-405b-b911-6a8222250ef8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:25.595858 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-33356736-0456-405b-b911-6a8222250ef8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:25.715786 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d0cf1b55-c9e1-42fd-8e6f-a5e993dc58da tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:25.723048 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d0cf1b55-c9e1-42fd-8e6f-a5e993dc58da tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.152325 Aug 17 23:47:25.723608 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 289/574] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:25 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:25.730243 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-33356736-0456-405b-b911-6a8222250ef8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:25.737619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-33356736-0456-405b-b911-6a8222250ef8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.154966 Aug 17 23:47:25.738157 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 286/575] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:25 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:25.879841 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-120f017f-8376-46b1-8850-145c48548a0e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:25.880473 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-120f017f-8376-46b1-8850-145c48548a0e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:25.886305 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-120f017f-8376-46b1-8850-145c48548a0e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:25.886783 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-120f017f-8376-46b1-8850-145c48548a0e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:25.887211 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-120f017f-8376-46b1-8850-145c48548a0e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:25.887888 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-120f017f-8376-46b1-8850-145c48548a0e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:25.888366 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-120f017f-8376-46b1-8850-145c48548a0e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:25.888787 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-120f017f-8376-46b1-8850-145c48548a0e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:25.916847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-8a432135-4b23-4e45-b167-33e8943d4b74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:25.917462 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-8a432135-4b23-4e45-b167-33e8943d4b74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:25.923314 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a432135-4b23-4e45-b167-33e8943d4b74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:25.923802 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a432135-4b23-4e45-b167-33e8943d4b74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:25.924274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a432135-4b23-4e45-b167-33e8943d4b74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:25.924998 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a432135-4b23-4e45-b167-33e8943d4b74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:25.925456 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a432135-4b23-4e45-b167-33e8943d4b74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:25.925880 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a432135-4b23-4e45-b167-33e8943d4b74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:26.017327 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-120f017f-8376-46b1-8850-145c48548a0e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:26.025685 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-120f017f-8376-46b1-8850-145c48548a0e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.149802 Aug 17 23:47:26.026247 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 290/576] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:25 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:26.056630 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8a432135-4b23-4e45-b167-33e8943d4b74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:26.064796 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8a432135-4b23-4e45-b167-33e8943d4b74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:26.066300 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8a432135-4b23-4e45-b167-33e8943d4b74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:26.067457 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-8a432135-4b23-4e45-b167-33e8943d4b74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.155212 Aug 17 23:47:26.068045 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 287/577] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:25 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:47:26.210644 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-85d21c19-91c1-45e5-b652-232343d2d039 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:26.211257 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-85d21c19-91c1-45e5-b652-232343d2d039 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:26.217961 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85d21c19-91c1-45e5-b652-232343d2d039 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:26.218448 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85d21c19-91c1-45e5-b652-232343d2d039 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:26.218885 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85d21c19-91c1-45e5-b652-232343d2d039 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:26.219576 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85d21c19-91c1-45e5-b652-232343d2d039 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:26.220062 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85d21c19-91c1-45e5-b652-232343d2d039 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:26.220495 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85d21c19-91c1-45e5-b652-232343d2d039 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:26.282222 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-85d21c19-91c1-45e5-b652-232343d2d039 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:26.289987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-85d21c19-91c1-45e5-b652-232343d2d039 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1205 microversion: 2.1 time: 0.083169 Aug 17 23:47:26.290556 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 291/578] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:26 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1205 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:26.744649 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-4c01d177-7225-411c-acb5-83572c1144ad tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:26.745265 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-4c01d177-7225-411c-acb5-83572c1144ad tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:26.751842 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4c01d177-7225-411c-acb5-83572c1144ad tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:26.752360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4c01d177-7225-411c-acb5-83572c1144ad tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:26.752798 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4c01d177-7225-411c-acb5-83572c1144ad tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:26.753676 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4c01d177-7225-411c-acb5-83572c1144ad tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:26.754021 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4c01d177-7225-411c-acb5-83572c1144ad tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:26.754525 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4c01d177-7225-411c-acb5-83572c1144ad tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:26.759162 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-bacb8665-9eed-40aa-9638-4dbae25df737 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:26.759810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-bacb8665-9eed-40aa-9638-4dbae25df737 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:26.765842 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bacb8665-9eed-40aa-9638-4dbae25df737 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:26.766322 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bacb8665-9eed-40aa-9638-4dbae25df737 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:26.766754 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bacb8665-9eed-40aa-9638-4dbae25df737 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:26.767437 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bacb8665-9eed-40aa-9638-4dbae25df737 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:26.767888 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bacb8665-9eed-40aa-9638-4dbae25df737 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:26.768346 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bacb8665-9eed-40aa-9638-4dbae25df737 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:26.884189 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-4c01d177-7225-411c-acb5-83572c1144ad tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:26.891612 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-4c01d177-7225-411c-acb5-83572c1144ad tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.151253 Aug 17 23:47:26.892397 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 288/579] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:26 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:26.906682 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-bacb8665-9eed-40aa-9638-4dbae25df737 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:26.914478 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-bacb8665-9eed-40aa-9638-4dbae25df737 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.159698 Aug 17 23:47:26.923995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 292/580] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:26 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:27.046718 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-d0363271-35da-455f-aceb-4089c0cbf467 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:27.047360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-d0363271-35da-455f-aceb-4089c0cbf467 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:27.053341 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d0363271-35da-455f-aceb-4089c0cbf467 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:27.053829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d0363271-35da-455f-aceb-4089c0cbf467 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:27.054270 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d0363271-35da-455f-aceb-4089c0cbf467 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:27.055817 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d0363271-35da-455f-aceb-4089c0cbf467 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:27.056710 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d0363271-35da-455f-aceb-4089c0cbf467 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:27.057173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d0363271-35da-455f-aceb-4089c0cbf467 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:27.091214 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-12ca22e6-48a8-4182-a170-67aad64b9724 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:27.091936 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-12ca22e6-48a8-4182-a170-67aad64b9724 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:27.098056 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-12ca22e6-48a8-4182-a170-67aad64b9724 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:27.098632 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-12ca22e6-48a8-4182-a170-67aad64b9724 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:27.099142 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-12ca22e6-48a8-4182-a170-67aad64b9724 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:27.099918 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-12ca22e6-48a8-4182-a170-67aad64b9724 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:27.100502 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-12ca22e6-48a8-4182-a170-67aad64b9724 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:27.100990 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-12ca22e6-48a8-4182-a170-67aad64b9724 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:27.188748 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d0363271-35da-455f-aceb-4089c0cbf467 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:27.196328 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-d0363271-35da-455f-aceb-4089c0cbf467 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.153414 Aug 17 23:47:27.196991 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 289/581] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:27 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:27.232351 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-12ca22e6-48a8-4182-a170-67aad64b9724 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:27.240619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-12ca22e6-48a8-4182-a170-67aad64b9724 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:27.242203 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-12ca22e6-48a8-4182-a170-67aad64b9724 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:27.244155 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-12ca22e6-48a8-4182-a170-67aad64b9724 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.157749 Aug 17 23:47:27.244707 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 293/582] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:27 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:47:27.309977 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-30e4a4bb-b3cf-43cd-9c40-62d31ed0ed09 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:27.310522 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-30e4a4bb-b3cf-43cd-9c40-62d31ed0ed09 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:27.316663 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30e4a4bb-b3cf-43cd-9c40-62d31ed0ed09 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:27.317186 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30e4a4bb-b3cf-43cd-9c40-62d31ed0ed09 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:27.317650 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30e4a4bb-b3cf-43cd-9c40-62d31ed0ed09 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:27.318371 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30e4a4bb-b3cf-43cd-9c40-62d31ed0ed09 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:27.318828 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30e4a4bb-b3cf-43cd-9c40-62d31ed0ed09 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:27.319256 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30e4a4bb-b3cf-43cd-9c40-62d31ed0ed09 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:27.380216 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-30e4a4bb-b3cf-43cd-9c40-62d31ed0ed09 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:27.387622 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-30e4a4bb-b3cf-43cd-9c40-62d31ed0ed09 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1205 microversion: 2.1 time: 0.082177 Aug 17 23:47:27.388227 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 290/583] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:27 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1205 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:27.911586 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-3073831c-59a5-495d-9d1a-f9f429cdb3c3 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:27.912230 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-3073831c-59a5-495d-9d1a-f9f429cdb3c3 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:27.918777 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3073831c-59a5-495d-9d1a-f9f429cdb3c3 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:27.919224 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3073831c-59a5-495d-9d1a-f9f429cdb3c3 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:27.919660 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3073831c-59a5-495d-9d1a-f9f429cdb3c3 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:27.920368 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3073831c-59a5-495d-9d1a-f9f429cdb3c3 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:27.920818 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3073831c-59a5-495d-9d1a-f9f429cdb3c3 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:27.921235 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3073831c-59a5-495d-9d1a-f9f429cdb3c3 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:27.936833 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-8836b546-6a3b-48db-9668-d3e10f2537fd tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:27.938363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-8836b546-6a3b-48db-9668-d3e10f2537fd tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:27.946855 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8836b546-6a3b-48db-9668-d3e10f2537fd tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:27.947765 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8836b546-6a3b-48db-9668-d3e10f2537fd tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:27.948500 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8836b546-6a3b-48db-9668-d3e10f2537fd tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:27.949501 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8836b546-6a3b-48db-9668-d3e10f2537fd tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:27.950168 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8836b546-6a3b-48db-9668-d3e10f2537fd tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:27.950818 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8836b546-6a3b-48db-9668-d3e10f2537fd tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:28.096526 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-3073831c-59a5-495d-9d1a-f9f429cdb3c3 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:28.104190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-3073831c-59a5-495d-9d1a-f9f429cdb3c3 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.196590 Aug 17 23:47:28.104764 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 294/584] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:27 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:28.152561 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8836b546-6a3b-48db-9668-d3e10f2537fd tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:28.168900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-8836b546-6a3b-48db-9668-d3e10f2537fd tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.236738 Aug 17 23:47:28.169820 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 291/585] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:27 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:28.217283 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-83af5c3c-9a32-4cf0-8d1a-a76d83693c52 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:28.228618 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-83af5c3c-9a32-4cf0-8d1a-a76d83693c52 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:28.244721 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-83af5c3c-9a32-4cf0-8d1a-a76d83693c52 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:28.245406 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-83af5c3c-9a32-4cf0-8d1a-a76d83693c52 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:28.245856 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-83af5c3c-9a32-4cf0-8d1a-a76d83693c52 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:28.248195 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-83af5c3c-9a32-4cf0-8d1a-a76d83693c52 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:28.248692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-83af5c3c-9a32-4cf0-8d1a-a76d83693c52 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:28.249131 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-83af5c3c-9a32-4cf0-8d1a-a76d83693c52 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:28.270188 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-21d0f77c-9441-4e0c-81b4-b9dca5a8979c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:28.270821 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-21d0f77c-9441-4e0c-81b4-b9dca5a8979c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:28.282687 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-21d0f77c-9441-4e0c-81b4-b9dca5a8979c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:28.283211 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-21d0f77c-9441-4e0c-81b4-b9dca5a8979c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:28.283666 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-21d0f77c-9441-4e0c-81b4-b9dca5a8979c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:28.286442 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-21d0f77c-9441-4e0c-81b4-b9dca5a8979c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:28.286938 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-21d0f77c-9441-4e0c-81b4-b9dca5a8979c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:28.289561 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-21d0f77c-9441-4e0c-81b4-b9dca5a8979c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:28.526150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-83af5c3c-9a32-4cf0-8d1a-a76d83693c52 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:28.534463 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-83af5c3c-9a32-4cf0-8d1a-a76d83693c52 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.320975 Aug 17 23:47:28.535277 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 295/586] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:28 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:28.540647 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-f687c8ed-48a7-4bf1-9d92-cc1e5761e261 req-29a733a0-f333-4372-ac90-a4c33a5a91fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12c673bc-cdc2-486b-a556-c6ce9a3fdb6c", "name": "network-vif-plugged", "status": "completed", "tag": "353d5d74-5ab4-43f3-b3ae-b06325dafe66"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:47:28.551755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-f687c8ed-48a7-4bf1-9d92-cc1e5761e261 req-29a733a0-f333-4372-ac90-a4c33a5a91fd service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:28.552350 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-f687c8ed-48a7-4bf1-9d92-cc1e5761e261 req-29a733a0-f333-4372-ac90-a4c33a5a91fd service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:28.552779 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-f687c8ed-48a7-4bf1-9d92-cc1e5761e261 req-29a733a0-f333-4372-ac90-a4c33a5a91fd service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:28.566357 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-f687c8ed-48a7-4bf1-9d92-cc1e5761e261 req-29a733a0-f333-4372-ac90-a4c33a5a91fd service nova] Creating event network-vif-plugged:353d5d74-5ab4-43f3-b3ae-b06325dafe66 for instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c on hv-cinder-82002 Aug 17 23:47:28.571900 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-f687c8ed-48a7-4bf1-9d92-cc1e5761e261 req-29a733a0-f333-4372-ac90-a4c33a5a91fd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035519 Aug 17 23:47:28.576183 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 296/587] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:47:28.580583 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-dba20707-6e56-4abb-8981-e601160b39f4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:28.581283 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-dba20707-6e56-4abb-8981-e601160b39f4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:28.587590 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dba20707-6e56-4abb-8981-e601160b39f4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:28.588153 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dba20707-6e56-4abb-8981-e601160b39f4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:28.588601 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dba20707-6e56-4abb-8981-e601160b39f4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:28.589309 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dba20707-6e56-4abb-8981-e601160b39f4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:28.589769 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dba20707-6e56-4abb-8981-e601160b39f4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:28.590197 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dba20707-6e56-4abb-8981-e601160b39f4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:28.649779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-21d0f77c-9441-4e0c-81b4-b9dca5a8979c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:28.659096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dba20707-6e56-4abb-8981-e601160b39f4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:28.664092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-21d0f77c-9441-4e0c-81b4-b9dca5a8979c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:28.667052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-21d0f77c-9441-4e0c-81b4-b9dca5a8979c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:28.668867 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-21d0f77c-9441-4e0c-81b4-b9dca5a8979c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.405577 Aug 17 23:47:28.671014 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-dba20707-6e56-4abb-8981-e601160b39f4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1205 microversion: 2.1 time: 0.094329 Aug 17 23:47:28.672375 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 297/588] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:28 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1205 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:28.686056 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 292/589] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:28 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:47:29.124374 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-2abc7ed8-e05a-4e05-8bb7-6e8b97518f0b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:29.125002 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-2abc7ed8-e05a-4e05-8bb7-6e8b97518f0b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:29.131290 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2abc7ed8-e05a-4e05-8bb7-6e8b97518f0b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:29.131768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2abc7ed8-e05a-4e05-8bb7-6e8b97518f0b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:29.132232 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2abc7ed8-e05a-4e05-8bb7-6e8b97518f0b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:29.132912 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2abc7ed8-e05a-4e05-8bb7-6e8b97518f0b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:29.133392 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2abc7ed8-e05a-4e05-8bb7-6e8b97518f0b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:29.133811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2abc7ed8-e05a-4e05-8bb7-6e8b97518f0b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:29.189732 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-954aa1af-de95-42e3-b19f-315d0c2f8d1a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:29.190335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-954aa1af-de95-42e3-b19f-315d0c2f8d1a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:29.196837 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-954aa1af-de95-42e3-b19f-315d0c2f8d1a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:29.197346 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-954aa1af-de95-42e3-b19f-315d0c2f8d1a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:29.197806 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-954aa1af-de95-42e3-b19f-315d0c2f8d1a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:29.198497 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-954aa1af-de95-42e3-b19f-315d0c2f8d1a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:29.198948 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-954aa1af-de95-42e3-b19f-315d0c2f8d1a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:29.199370 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-954aa1af-de95-42e3-b19f-315d0c2f8d1a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:29.265955 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-2abc7ed8-e05a-4e05-8bb7-6e8b97518f0b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:29.273349 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-2abc7ed8-e05a-4e05-8bb7-6e8b97518f0b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.152821 Aug 17 23:47:29.274525 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 298/590] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:29 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:29.332559 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-954aa1af-de95-42e3-b19f-315d0c2f8d1a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:29.336031 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=100 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:47:29.341628 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-954aa1af-de95-42e3-b19f-315d0c2f8d1a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.155769 Aug 17 23:47:29.342187 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 293/591] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:29 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:29.556121 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-af5b2bd0-38a7-4810-b1d5-defea07110f9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:29.556741 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-af5b2bd0-38a7-4810-b1d5-defea07110f9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:29.562602 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af5b2bd0-38a7-4810-b1d5-defea07110f9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:29.563086 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af5b2bd0-38a7-4810-b1d5-defea07110f9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:29.563522 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af5b2bd0-38a7-4810-b1d5-defea07110f9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:29.564319 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af5b2bd0-38a7-4810-b1d5-defea07110f9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:29.564778 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af5b2bd0-38a7-4810-b1d5-defea07110f9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:29.565204 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af5b2bd0-38a7-4810-b1d5-defea07110f9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:29.569139 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=100 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:47:29.692411 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ab098a84-e5ed-4c6e-b67a-5beb72a64295 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:29.692838 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-af5b2bd0-38a7-4810-b1d5-defea07110f9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:29.693036 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ab098a84-e5ed-4c6e-b67a-5beb72a64295 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:29.699885 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ab098a84-e5ed-4c6e-b67a-5beb72a64295 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:29.700412 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ab098a84-e5ed-4c6e-b67a-5beb72a64295 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:29.700986 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ab098a84-e5ed-4c6e-b67a-5beb72a64295 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:29.701104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-af5b2bd0-38a7-4810-b1d5-defea07110f9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.148757 Aug 17 23:47:29.701565 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 299/592] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:29 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:29.701704 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ab098a84-e5ed-4c6e-b67a-5beb72a64295 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:29.702138 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ab098a84-e5ed-4c6e-b67a-5beb72a64295 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:29.702565 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ab098a84-e5ed-4c6e-b67a-5beb72a64295 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:29.706085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-db8330ca-91ac-46cb-9a31-ead9ee339766 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:29.706689 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-db8330ca-91ac-46cb-9a31-ead9ee339766 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:29.712773 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-db8330ca-91ac-46cb-9a31-ead9ee339766 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:29.713264 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-db8330ca-91ac-46cb-9a31-ead9ee339766 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:29.713712 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-db8330ca-91ac-46cb-9a31-ead9ee339766 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:29.714402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-db8330ca-91ac-46cb-9a31-ead9ee339766 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:29.714855 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-db8330ca-91ac-46cb-9a31-ead9ee339766 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:29.715305 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-db8330ca-91ac-46cb-9a31-ead9ee339766 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:29.832674 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ab098a84-e5ed-4c6e-b67a-5beb72a64295 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:29.840168 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ab098a84-e5ed-4c6e-b67a-5beb72a64295 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1272 microversion: 2.1 time: 0.152037 Aug 17 23:47:29.840741 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 294/593] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:29 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1272 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:29.854455 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-db8330ca-91ac-46cb-9a31-ead9ee339766 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:29.862447 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-db8330ca-91ac-46cb-9a31-ead9ee339766 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:29.863938 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-db8330ca-91ac-46cb-9a31-ead9ee339766 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:29.865113 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-db8330ca-91ac-46cb-9a31-ead9ee339766 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.162652 Aug 17 23:47:29.865669 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 300/594] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:29 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:30.294616 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3a600a0d-f625-4af7-9a13-5090a4d8dca4 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:30.295264 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3a600a0d-f625-4af7-9a13-5090a4d8dca4 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:30.301709 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3a600a0d-f625-4af7-9a13-5090a4d8dca4 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:30.302191 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3a600a0d-f625-4af7-9a13-5090a4d8dca4 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:30.302629 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3a600a0d-f625-4af7-9a13-5090a4d8dca4 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:30.303326 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3a600a0d-f625-4af7-9a13-5090a4d8dca4 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:30.303816 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3a600a0d-f625-4af7-9a13-5090a4d8dca4 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:30.304429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3a600a0d-f625-4af7-9a13-5090a4d8dca4 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:30.362267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b90cf5c7-d718-4d6e-b913-8f3a8b74f137 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:30.363016 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b90cf5c7-d718-4d6e-b913-8f3a8b74f137 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:30.369503 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b90cf5c7-d718-4d6e-b913-8f3a8b74f137 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:30.370065 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b90cf5c7-d718-4d6e-b913-8f3a8b74f137 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:30.370412 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b90cf5c7-d718-4d6e-b913-8f3a8b74f137 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:30.371185 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b90cf5c7-d718-4d6e-b913-8f3a8b74f137 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:30.371646 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b90cf5c7-d718-4d6e-b913-8f3a8b74f137 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:30.372096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b90cf5c7-d718-4d6e-b913-8f3a8b74f137 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:30.458839 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3a600a0d-f625-4af7-9a13-5090a4d8dca4 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:30.467342 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3a600a0d-f625-4af7-9a13-5090a4d8dca4 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.176527 Aug 17 23:47:30.467913 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 295/595] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:30 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:30.504566 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b90cf5c7-d718-4d6e-b913-8f3a8b74f137 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:30.515492 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b90cf5c7-d718-4d6e-b913-8f3a8b74f137 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.157167 Aug 17 23:47:30.516085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 301/596] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:30 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:30.721685 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-05465df4-0112-437b-8341-c6078013d5b7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:30.722332 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-05465df4-0112-437b-8341-c6078013d5b7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:30.728387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-05465df4-0112-437b-8341-c6078013d5b7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:30.728870 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-05465df4-0112-437b-8341-c6078013d5b7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:30.729309 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-05465df4-0112-437b-8341-c6078013d5b7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:30.729993 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-05465df4-0112-437b-8341-c6078013d5b7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:30.730448 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-05465df4-0112-437b-8341-c6078013d5b7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:30.730870 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-05465df4-0112-437b-8341-c6078013d5b7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:30.857453 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-05465df4-0112-437b-8341-c6078013d5b7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:30.860739 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e54fb245-1f33-496a-8c5b-3518a9b38949 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:30.861358 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e54fb245-1f33-496a-8c5b-3518a9b38949 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:30.865053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-05465df4-0112-437b-8341-c6078013d5b7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.147206 Aug 17 23:47:30.865619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 296/597] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:30 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:30.867202 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e54fb245-1f33-496a-8c5b-3518a9b38949 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:30.868309 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e54fb245-1f33-496a-8c5b-3518a9b38949 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:30.868756 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e54fb245-1f33-496a-8c5b-3518a9b38949 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:30.869448 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e54fb245-1f33-496a-8c5b-3518a9b38949 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:30.869912 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e54fb245-1f33-496a-8c5b-3518a9b38949 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:30.870338 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e54fb245-1f33-496a-8c5b-3518a9b38949 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:30.887820 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2a239999-6b2c-4d8c-858b-29da57899885 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:30.888455 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2a239999-6b2c-4d8c-858b-29da57899885 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:30.894317 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2a239999-6b2c-4d8c-858b-29da57899885 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:30.894862 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2a239999-6b2c-4d8c-858b-29da57899885 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:30.895309 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2a239999-6b2c-4d8c-858b-29da57899885 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:30.896023 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2a239999-6b2c-4d8c-858b-29da57899885 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:30.896480 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2a239999-6b2c-4d8c-858b-29da57899885 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:30.896903 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2a239999-6b2c-4d8c-858b-29da57899885 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:31.000421 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e54fb245-1f33-496a-8c5b-3518a9b38949 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:31.008428 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e54fb245-1f33-496a-8c5b-3518a9b38949 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1272 microversion: 2.1 time: 0.151599 Aug 17 23:47:31.009362 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 302/598] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:30 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1272 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:31.028118 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2a239999-6b2c-4d8c-858b-29da57899885 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:31.036349 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2a239999-6b2c-4d8c-858b-29da57899885 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:31.037855 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2a239999-6b2c-4d8c-858b-29da57899885 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:31.039211 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2a239999-6b2c-4d8c-858b-29da57899885 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.155155 Aug 17 23:47:31.040465 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 297/599] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:30 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:47:31.488036 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c31f04bf-7235-4bcf-af76-3dfe87649ae2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:31.488653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c31f04bf-7235-4bcf-af76-3dfe87649ae2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:31.495117 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c31f04bf-7235-4bcf-af76-3dfe87649ae2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:31.495602 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c31f04bf-7235-4bcf-af76-3dfe87649ae2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:31.496069 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c31f04bf-7235-4bcf-af76-3dfe87649ae2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:31.496757 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c31f04bf-7235-4bcf-af76-3dfe87649ae2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:31.497215 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c31f04bf-7235-4bcf-af76-3dfe87649ae2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:31.497638 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c31f04bf-7235-4bcf-af76-3dfe87649ae2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:31.536434 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-bd970e85-1d4f-4916-bb6e-190d46cbc578 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:31.537072 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-bd970e85-1d4f-4916-bb6e-190d46cbc578 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:31.543396 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bd970e85-1d4f-4916-bb6e-190d46cbc578 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:31.543880 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bd970e85-1d4f-4916-bb6e-190d46cbc578 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:31.544347 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bd970e85-1d4f-4916-bb6e-190d46cbc578 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:31.545051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bd970e85-1d4f-4916-bb6e-190d46cbc578 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:31.545506 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bd970e85-1d4f-4916-bb6e-190d46cbc578 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:31.545930 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bd970e85-1d4f-4916-bb6e-190d46cbc578 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:31.628954 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c31f04bf-7235-4bcf-af76-3dfe87649ae2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:31.637115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c31f04bf-7235-4bcf-af76-3dfe87649ae2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.152997 Aug 17 23:47:31.637675 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 303/600] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:31 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:31.681958 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-bd970e85-1d4f-4916-bb6e-190d46cbc578 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:31.689581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-bd970e85-1d4f-4916-bb6e-190d46cbc578 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.157427 Aug 17 23:47:31.690145 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 298/601] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:31 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:31.887259 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-43be46e9-5155-4a30-a1d5-8c0256a5e224 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:31.893272 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-43be46e9-5155-4a30-a1d5-8c0256a5e224 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:31.912479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-43be46e9-5155-4a30-a1d5-8c0256a5e224 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:31.914125 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-43be46e9-5155-4a30-a1d5-8c0256a5e224 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:31.914763 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-43be46e9-5155-4a30-a1d5-8c0256a5e224 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:31.916186 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-43be46e9-5155-4a30-a1d5-8c0256a5e224 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:31.916834 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-43be46e9-5155-4a30-a1d5-8c0256a5e224 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:31.917596 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-43be46e9-5155-4a30-a1d5-8c0256a5e224 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:32.029085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c0384562-af47-4dad-9258-0ff412e3f1d2 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:32.029711 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c0384562-af47-4dad-9258-0ff412e3f1d2 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:32.035692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0384562-af47-4dad-9258-0ff412e3f1d2 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:32.036481 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0384562-af47-4dad-9258-0ff412e3f1d2 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:32.036914 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0384562-af47-4dad-9258-0ff412e3f1d2 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:32.037812 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0384562-af47-4dad-9258-0ff412e3f1d2 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:32.038265 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0384562-af47-4dad-9258-0ff412e3f1d2 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:32.038851 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0384562-af47-4dad-9258-0ff412e3f1d2 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:32.088344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-43be46e9-5155-4a30-a1d5-8c0256a5e224 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:32.095918 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-43be46e9-5155-4a30-a1d5-8c0256a5e224 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.213083 Aug 17 23:47:32.096504 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 304/602] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:31 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:32.101035 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-202d3f5e-153a-45f6-b6dd-caad48fe231c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:32.101649 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-202d3f5e-153a-45f6-b6dd-caad48fe231c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:32.107394 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-202d3f5e-153a-45f6-b6dd-caad48fe231c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:32.107887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-202d3f5e-153a-45f6-b6dd-caad48fe231c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:32.108381 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-202d3f5e-153a-45f6-b6dd-caad48fe231c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:32.109089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-202d3f5e-153a-45f6-b6dd-caad48fe231c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:32.109543 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-202d3f5e-153a-45f6-b6dd-caad48fe231c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:32.109970 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-202d3f5e-153a-45f6-b6dd-caad48fe231c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:32.247603 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-202d3f5e-153a-45f6-b6dd-caad48fe231c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:32.256160 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-202d3f5e-153a-45f6-b6dd-caad48fe231c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:32.257671 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-202d3f5e-153a-45f6-b6dd-caad48fe231c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:32.259476 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-202d3f5e-153a-45f6-b6dd-caad48fe231c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.162053 Aug 17 23:47:32.260293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 305/603] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:32 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:32.425452 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-8448dc3d-11ea-4e16-81ed-3eda4a5dfe75 req-7558eba3-9331-4ce4-9e72-2f5fbbc4a325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3", "name": "network-vif-plugged", "status": "completed", "tag": "dfa9d9dc-5ba7-401c-ba5e-15d6312bb95f"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:47:32.438603 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-8448dc3d-11ea-4e16-81ed-3eda4a5dfe75 req-7558eba3-9331-4ce4-9e72-2f5fbbc4a325 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:32.443882 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-8448dc3d-11ea-4e16-81ed-3eda4a5dfe75 req-7558eba3-9331-4ce4-9e72-2f5fbbc4a325 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:32.443882 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-8448dc3d-11ea-4e16-81ed-3eda4a5dfe75 req-7558eba3-9331-4ce4-9e72-2f5fbbc4a325 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:32.454694 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-8448dc3d-11ea-4e16-81ed-3eda4a5dfe75 req-7558eba3-9331-4ce4-9e72-2f5fbbc4a325 service nova] Creating event network-vif-plugged:dfa9d9dc-5ba7-401c-ba5e-15d6312bb95f for instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 on hv-cinder-82002 Aug 17 23:47:32.459788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-8448dc3d-11ea-4e16-81ed-3eda4a5dfe75 req-7558eba3-9331-4ce4-9e72-2f5fbbc4a325 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038191 Aug 17 23:47:32.461255 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 306/604] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:47:32.550941 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c0384562-af47-4dad-9258-0ff412e3f1d2 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:32.559249 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c0384562-af47-4dad-9258-0ff412e3f1d2 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1260 microversion: 2.1 time: 0.534064 Aug 17 23:47:32.559815 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 299/605] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:32 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1260 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:32.659616 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-57d8fdae-6b6b-49cc-a8ac-6c9587150618 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:32.660468 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-57d8fdae-6b6b-49cc-a8ac-6c9587150618 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:32.667073 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-57d8fdae-6b6b-49cc-a8ac-6c9587150618 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:32.667638 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-57d8fdae-6b6b-49cc-a8ac-6c9587150618 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:32.668194 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-57d8fdae-6b6b-49cc-a8ac-6c9587150618 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:32.668972 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-57d8fdae-6b6b-49cc-a8ac-6c9587150618 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:32.669504 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-57d8fdae-6b6b-49cc-a8ac-6c9587150618 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:32.670024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-57d8fdae-6b6b-49cc-a8ac-6c9587150618 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:32.710721 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-8d897ab4-43ea-4a24-8780-ead5babbe1f7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:32.711687 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-8d897ab4-43ea-4a24-8780-ead5babbe1f7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:32.719103 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8d897ab4-43ea-4a24-8780-ead5babbe1f7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:32.719644 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8d897ab4-43ea-4a24-8780-ead5babbe1f7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:32.720073 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8d897ab4-43ea-4a24-8780-ead5babbe1f7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:32.720722 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8d897ab4-43ea-4a24-8780-ead5babbe1f7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:32.721453 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8d897ab4-43ea-4a24-8780-ead5babbe1f7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:32.721875 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8d897ab4-43ea-4a24-8780-ead5babbe1f7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:32.810649 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-57d8fdae-6b6b-49cc-a8ac-6c9587150618 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:32.818919 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-57d8fdae-6b6b-49cc-a8ac-6c9587150618 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.163981 Aug 17 23:47:32.819491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 307/606] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:32 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:32.877852 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-c9e616c3-97c9-4a4e-b0bf-4be0b44e59b8 req-72b6fc29-a3c5-4255-befe-d4284304932f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93126672-4679-41e5-bfbd-f06836afac17", "tag": "da8d102a-c017-4932-bfb8-b3ef13097d11"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:47:32.887538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-c9e616c3-97c9-4a4e-b0bf-4be0b44e59b8 req-72b6fc29-a3c5-4255-befe-d4284304932f service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:32.888124 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-c9e616c3-97c9-4a4e-b0bf-4be0b44e59b8 req-72b6fc29-a3c5-4255-befe-d4284304932f service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:32.888621 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-c9e616c3-97c9-4a4e-b0bf-4be0b44e59b8 req-72b6fc29-a3c5-4255-befe-d4284304932f service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:32.899209 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-c9e616c3-97c9-4a4e-b0bf-4be0b44e59b8 req-72b6fc29-a3c5-4255-befe-d4284304932f service nova] Creating event network-changed:da8d102a-c017-4932-bfb8-b3ef13097d11 for instance 93126672-4679-41e5-bfbd-f06836afac17 on hv-cinder-82002 Aug 17 23:47:32.904134 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-c9e616c3-97c9-4a4e-b0bf-4be0b44e59b8 req-72b6fc29-a3c5-4255-befe-d4284304932f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029957 Aug 17 23:47:32.904805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 308/607] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:47:32.937231 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8d897ab4-43ea-4a24-8780-ead5babbe1f7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:32.946563 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-8d897ab4-43ea-4a24-8780-ead5babbe1f7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1266 microversion: 2.1 time: 0.239249 Aug 17 23:47:32.947141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 300/608] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:32 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:33.119139 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ed396747-8edc-41d8-ba71-9266e8622a1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:33.120110 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ed396747-8edc-41d8-ba71-9266e8622a1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:33.127194 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ed396747-8edc-41d8-ba71-9266e8622a1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:33.127809 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ed396747-8edc-41d8-ba71-9266e8622a1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:33.128378 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ed396747-8edc-41d8-ba71-9266e8622a1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:33.129936 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ed396747-8edc-41d8-ba71-9266e8622a1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:33.130503 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ed396747-8edc-41d8-ba71-9266e8622a1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:33.131034 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ed396747-8edc-41d8-ba71-9266e8622a1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:33.282980 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9b8af713-eb45-45cf-9f15-0f6f43003b61 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:33.283784 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9b8af713-eb45-45cf-9f15-0f6f43003b61 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:33.290919 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9b8af713-eb45-45cf-9f15-0f6f43003b61 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:33.291480 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9b8af713-eb45-45cf-9f15-0f6f43003b61 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:33.292005 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9b8af713-eb45-45cf-9f15-0f6f43003b61 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:33.292941 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9b8af713-eb45-45cf-9f15-0f6f43003b61 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:33.293581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9b8af713-eb45-45cf-9f15-0f6f43003b61 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:33.294222 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9b8af713-eb45-45cf-9f15-0f6f43003b61 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:33.410666 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ed396747-8edc-41d8-ba71-9266e8622a1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:33.421499 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ed396747-8edc-41d8-ba71-9266e8622a1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.307723 Aug 17 23:47:33.434816 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 309/609] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:33 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:33.522173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9b8af713-eb45-45cf-9f15-0f6f43003b61 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:33.530392 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9b8af713-eb45-45cf-9f15-0f6f43003b61 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:33.531894 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9b8af713-eb45-45cf-9f15-0f6f43003b61 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:33.533085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9b8af713-eb45-45cf-9f15-0f6f43003b61 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.254134 Aug 17 23:47:33.533690 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 301/610] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:33 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:47:33.580063 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9257eaa4-fce1-4fa6-b566-5161ae822cc4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:33.580807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9257eaa4-fce1-4fa6-b566-5161ae822cc4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:33.587087 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9257eaa4-fce1-4fa6-b566-5161ae822cc4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:33.587683 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9257eaa4-fce1-4fa6-b566-5161ae822cc4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:33.588228 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9257eaa4-fce1-4fa6-b566-5161ae822cc4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:33.588922 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9257eaa4-fce1-4fa6-b566-5161ae822cc4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:33.589390 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9257eaa4-fce1-4fa6-b566-5161ae822cc4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:33.589803 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9257eaa4-fce1-4fa6-b566-5161ae822cc4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:33.718697 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9257eaa4-fce1-4fa6-b566-5161ae822cc4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:33.726065 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9257eaa4-fce1-4fa6-b566-5161ae822cc4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1260 microversion: 2.1 time: 0.149860 Aug 17 23:47:33.726626 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 310/611] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:33 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:33.840609 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3070e0d7-a195-4aaa-8e55-0f37934e96f8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:33.841221 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3070e0d7-a195-4aaa-8e55-0f37934e96f8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:33.847544 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3070e0d7-a195-4aaa-8e55-0f37934e96f8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:33.848052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3070e0d7-a195-4aaa-8e55-0f37934e96f8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:33.848489 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3070e0d7-a195-4aaa-8e55-0f37934e96f8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:33.849175 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3070e0d7-a195-4aaa-8e55-0f37934e96f8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:33.849632 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3070e0d7-a195-4aaa-8e55-0f37934e96f8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:33.850054 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3070e0d7-a195-4aaa-8e55-0f37934e96f8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:33.966546 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9479c488-cfe3-4615-acd0-34c6ff12616c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:33.967162 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9479c488-cfe3-4615-acd0-34c6ff12616c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:33.973018 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9479c488-cfe3-4615-acd0-34c6ff12616c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:33.973487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9479c488-cfe3-4615-acd0-34c6ff12616c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:33.973929 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9479c488-cfe3-4615-acd0-34c6ff12616c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:33.974620 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9479c488-cfe3-4615-acd0-34c6ff12616c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:33.975074 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9479c488-cfe3-4615-acd0-34c6ff12616c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:33.975493 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9479c488-cfe3-4615-acd0-34c6ff12616c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:33.979514 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3070e0d7-a195-4aaa-8e55-0f37934e96f8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:33.987067 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3070e0d7-a195-4aaa-8e55-0f37934e96f8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.150285 Aug 17 23:47:33.987656 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 302/612] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:33 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:34.234591 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9479c488-cfe3-4615-acd0-34c6ff12616c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:34.243630 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9479c488-cfe3-4615-acd0-34c6ff12616c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1454 microversion: 2.1 time: 0.280744 Aug 17 23:47:34.244327 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 311/613] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:33 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1454 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:34.265878 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-da657c5d-16e5-4db7-bbc6-89f33bb3e68e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:34.266500 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-da657c5d-16e5-4db7-bbc6-89f33bb3e68e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:34.275422 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-da657c5d-16e5-4db7-bbc6-89f33bb3e68e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:34.276264 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-da657c5d-16e5-4db7-bbc6-89f33bb3e68e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:34.276865 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-da657c5d-16e5-4db7-bbc6-89f33bb3e68e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:34.277681 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-da657c5d-16e5-4db7-bbc6-89f33bb3e68e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:34.278660 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-da657c5d-16e5-4db7-bbc6-89f33bb3e68e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:34.278660 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-da657c5d-16e5-4db7-bbc6-89f33bb3e68e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:34.429725 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-da657c5d-16e5-4db7-bbc6-89f33bb3e68e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:34.438374 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-da657c5d-16e5-4db7-bbc6-89f33bb3e68e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1454 microversion: 2.1 time: 0.177137 Aug 17 23:47:34.451691 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-28fd842e-92a6-4c63-aa53-f0ca2680901b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:34.451691 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-28fd842e-92a6-4c63-aa53-f0ca2680901b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:34.453167 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 303/614] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:34 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1454 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:34.470344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-28fd842e-92a6-4c63-aa53-f0ca2680901b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:34.471000 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-28fd842e-92a6-4c63-aa53-f0ca2680901b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:34.471854 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-28fd842e-92a6-4c63-aa53-f0ca2680901b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:34.473196 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-28fd842e-92a6-4c63-aa53-f0ca2680901b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:34.474434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-28fd842e-92a6-4c63-aa53-f0ca2680901b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:34.474832 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-28fd842e-92a6-4c63-aa53-f0ca2680901b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:34.556320 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e08c9365-5762-4c78-9468-b437e154ed36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:34.557231 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e08c9365-5762-4c78-9468-b437e154ed36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:34.563783 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e08c9365-5762-4c78-9468-b437e154ed36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:34.564339 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e08c9365-5762-4c78-9468-b437e154ed36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:34.564837 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e08c9365-5762-4c78-9468-b437e154ed36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:34.565574 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e08c9365-5762-4c78-9468-b437e154ed36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:34.566038 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e08c9365-5762-4c78-9468-b437e154ed36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:34.566465 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e08c9365-5762-4c78-9468-b437e154ed36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:34.674065 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-28fd842e-92a6-4c63-aa53-f0ca2680901b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:34.682356 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-28fd842e-92a6-4c63-aa53-f0ca2680901b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.237347 Aug 17 23:47:34.682935 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 312/615] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:34 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:34.746822 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f421f418-b580-48c4-af1d-d145da88c395 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:34.747541 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f421f418-b580-48c4-af1d-d145da88c395 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:34.753774 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f421f418-b580-48c4-af1d-d145da88c395 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:34.754268 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f421f418-b580-48c4-af1d-d145da88c395 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:34.754707 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f421f418-b580-48c4-af1d-d145da88c395 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:34.755418 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f421f418-b580-48c4-af1d-d145da88c395 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:34.755872 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f421f418-b580-48c4-af1d-d145da88c395 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:34.756480 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f421f418-b580-48c4-af1d-d145da88c395 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:34.770457 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e08c9365-5762-4c78-9468-b437e154ed36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:34.779186 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e08c9365-5762-4c78-9468-b437e154ed36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:34.780807 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e08c9365-5762-4c78-9468-b437e154ed36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:34.782031 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e08c9365-5762-4c78-9468-b437e154ed36 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.229819 Aug 17 23:47:34.782915 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 304/616] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:34 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:47:34.996095 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f421f418-b580-48c4-af1d-d145da88c395 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:35.006366 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f421f418-b580-48c4-af1d-d145da88c395 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1260 microversion: 2.1 time: 0.263332 Aug 17 23:47:35.007250 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 313/617] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:34 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1260 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:35.021673 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5cc43838-aa20-4682-8506-a7a36e5b3027 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:35.022317 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5cc43838-aa20-4682-8506-a7a36e5b3027 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:35.028618 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5cc43838-aa20-4682-8506-a7a36e5b3027 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:35.029099 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5cc43838-aa20-4682-8506-a7a36e5b3027 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:35.029531 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5cc43838-aa20-4682-8506-a7a36e5b3027 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:35.030264 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5cc43838-aa20-4682-8506-a7a36e5b3027 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:35.030716 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5cc43838-aa20-4682-8506-a7a36e5b3027 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:35.031136 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5cc43838-aa20-4682-8506-a7a36e5b3027 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:35.167296 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5cc43838-aa20-4682-8506-a7a36e5b3027 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:35.175087 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5cc43838-aa20-4682-8506-a7a36e5b3027 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.171026 Aug 17 23:47:35.175871 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 305/618] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:35 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:35.703566 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c2441c9e-dae5-4228-b865-358c502c9920 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:35.704204 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c2441c9e-dae5-4228-b865-358c502c9920 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:35.706617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=100 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:47:35.712034 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c2441c9e-dae5-4228-b865-358c502c9920 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:35.712522 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c2441c9e-dae5-4228-b865-358c502c9920 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:35.712959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c2441c9e-dae5-4228-b865-358c502c9920 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:35.713652 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c2441c9e-dae5-4228-b865-358c502c9920 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:35.714099 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c2441c9e-dae5-4228-b865-358c502c9920 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:35.714520 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c2441c9e-dae5-4228-b865-358c502c9920 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:35.808050 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-41ce969e-8f5f-4c5a-b563-45cd2395622b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:35.812880 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-41ce969e-8f5f-4c5a-b563-45cd2395622b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:35.829679 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-41ce969e-8f5f-4c5a-b563-45cd2395622b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:35.830189 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-41ce969e-8f5f-4c5a-b563-45cd2395622b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:35.830634 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-41ce969e-8f5f-4c5a-b563-45cd2395622b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:35.831352 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-41ce969e-8f5f-4c5a-b563-45cd2395622b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:35.831811 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-41ce969e-8f5f-4c5a-b563-45cd2395622b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:35.832274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-41ce969e-8f5f-4c5a-b563-45cd2395622b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:35.927437 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c2441c9e-dae5-4228-b865-358c502c9920 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:35.936547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c2441c9e-dae5-4228-b865-358c502c9920 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1365 microversion: 2.1 time: 0.236756 Aug 17 23:47:35.937118 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 314/619] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:35 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:36.026661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d2fc15e8-c4c4-4d09-85fb-a61f5c371e4f tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:36.027752 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d2fc15e8-c4c4-4d09-85fb-a61f5c371e4f tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:36.033961 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d2fc15e8-c4c4-4d09-85fb-a61f5c371e4f tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:36.034536 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d2fc15e8-c4c4-4d09-85fb-a61f5c371e4f tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:36.035045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d2fc15e8-c4c4-4d09-85fb-a61f5c371e4f tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:36.035848 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d2fc15e8-c4c4-4d09-85fb-a61f5c371e4f tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:36.036615 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d2fc15e8-c4c4-4d09-85fb-a61f5c371e4f tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:36.037245 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d2fc15e8-c4c4-4d09-85fb-a61f5c371e4f tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:36.040867 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-41ce969e-8f5f-4c5a-b563-45cd2395622b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:36.050334 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-41ce969e-8f5f-4c5a-b563-45cd2395622b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:36.052986 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-41ce969e-8f5f-4c5a-b563-45cd2395622b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:36.054302 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-41ce969e-8f5f-4c5a-b563-45cd2395622b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.253398 Aug 17 23:47:36.067995 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 306/620] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:35 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:36.196076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-dd0dde43-8b6a-4bde-8ba4-6e6c8223a036 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:36.196620 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-dd0dde43-8b6a-4bde-8ba4-6e6c8223a036 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:36.202611 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dd0dde43-8b6a-4bde-8ba4-6e6c8223a036 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:36.203159 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dd0dde43-8b6a-4bde-8ba4-6e6c8223a036 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:36.203608 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dd0dde43-8b6a-4bde-8ba4-6e6c8223a036 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:36.204552 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dd0dde43-8b6a-4bde-8ba4-6e6c8223a036 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:36.204791 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dd0dde43-8b6a-4bde-8ba4-6e6c8223a036 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:36.205228 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dd0dde43-8b6a-4bde-8ba4-6e6c8223a036 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:36.286655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d2fc15e8-c4c4-4d09-85fb-a61f5c371e4f tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:36.294938 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d2fc15e8-c4c4-4d09-85fb-a61f5c371e4f tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1260 microversion: 2.1 time: 0.272133 Aug 17 23:47:36.295514 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 315/621] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:36 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1260 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:36.337073 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-dd0dde43-8b6a-4bde-8ba4-6e6c8223a036 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:36.344515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-dd0dde43-8b6a-4bde-8ba4-6e6c8223a036 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.152368 Aug 17 23:47:36.345086 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 307/622] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:36 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:36.574334 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-87ccf7a5-1a80-432c-a500-96c48b48ea56 req-483b1212-5174-46d8-b361-7c0d09c977e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12c673bc-cdc2-486b-a556-c6ce9a3fdb6c", "tag": "353d5d74-5ab4-43f3-b3ae-b06325dafe66"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:47:36.583571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-87ccf7a5-1a80-432c-a500-96c48b48ea56 req-483b1212-5174-46d8-b361-7c0d09c977e2 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:36.584084 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-87ccf7a5-1a80-432c-a500-96c48b48ea56 req-483b1212-5174-46d8-b361-7c0d09c977e2 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:36.584548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-87ccf7a5-1a80-432c-a500-96c48b48ea56 req-483b1212-5174-46d8-b361-7c0d09c977e2 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:36.598895 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-87ccf7a5-1a80-432c-a500-96c48b48ea56 req-483b1212-5174-46d8-b361-7c0d09c977e2 service nova] Creating event network-changed:353d5d74-5ab4-43f3-b3ae-b06325dafe66 for instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c on hv-cinder-82002 Aug 17 23:47:36.605958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-87ccf7a5-1a80-432c-a500-96c48b48ea56 req-483b1212-5174-46d8-b361-7c0d09c977e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035203 Aug 17 23:47:36.606551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 316/623] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:47:36.964530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-454b32ab-4d0d-4930-913f-d16316769cda tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:36.966371 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-454b32ab-4d0d-4930-913f-d16316769cda tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:36.976770 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-454b32ab-4d0d-4930-913f-d16316769cda tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:36.978356 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-454b32ab-4d0d-4930-913f-d16316769cda tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:36.979322 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-454b32ab-4d0d-4930-913f-d16316769cda tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:36.980324 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-454b32ab-4d0d-4930-913f-d16316769cda tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:36.980939 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-454b32ab-4d0d-4930-913f-d16316769cda tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:36.982228 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-454b32ab-4d0d-4930-913f-d16316769cda tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:37.042016 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-68d86845-777c-4fac-8a74-e1b6c733d393 req-85b94ec5-0775-44c4-ba49-c3956c3cdd56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930c290f-5bb3-44fe-857d-9d5423eca017", "name": "network-vif-plugged", "status": "completed", "tag": "e95c1c30-368b-4623-86e2-0d608e9a186a"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:47:37.063280 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-68d86845-777c-4fac-8a74-e1b6c733d393 req-85b94ec5-0775-44c4-ba49-c3956c3cdd56 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:37.063775 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-68d86845-777c-4fac-8a74-e1b6c733d393 req-85b94ec5-0775-44c4-ba49-c3956c3cdd56 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:37.064225 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-68d86845-777c-4fac-8a74-e1b6c733d393 req-85b94ec5-0775-44c4-ba49-c3956c3cdd56 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:37.077917 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-68d86845-777c-4fac-8a74-e1b6c733d393 req-85b94ec5-0775-44c4-ba49-c3956c3cdd56 service nova] Creating event network-vif-plugged:e95c1c30-368b-4623-86e2-0d608e9a186a for instance 930c290f-5bb3-44fe-857d-9d5423eca017 on hv-cinder-82002 Aug 17 23:47:37.083099 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-68d86845-777c-4fac-8a74-e1b6c733d393 req-85b94ec5-0775-44c4-ba49-c3956c3cdd56 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046859 Aug 17 23:47:37.084227 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 317/624] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:47:37.090007 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9203b231-e258-49f0-a50b-b0b4ada4be59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:37.090925 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9203b231-e258-49f0-a50b-b0b4ada4be59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:37.097517 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9203b231-e258-49f0-a50b-b0b4ada4be59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:37.098251 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9203b231-e258-49f0-a50b-b0b4ada4be59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:37.098840 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9203b231-e258-49f0-a50b-b0b4ada4be59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:37.099705 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9203b231-e258-49f0-a50b-b0b4ada4be59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:37.100369 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9203b231-e258-49f0-a50b-b0b4ada4be59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:37.100978 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9203b231-e258-49f0-a50b-b0b4ada4be59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:37.117084 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=100 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:47:37.297525 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-454b32ab-4d0d-4930-913f-d16316769cda tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:37.299731 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9203b231-e258-49f0-a50b-b0b4ada4be59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:37.314845 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9203b231-e258-49f0-a50b-b0b4ada4be59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:37.316695 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9203b231-e258-49f0-a50b-b0b4ada4be59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:37.317750 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9203b231-e258-49f0-a50b-b0b4ada4be59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.232276 Aug 17 23:47:37.318289 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 318/625] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:37 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:37.325228 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-cde37eea-e2ee-478d-9b26-24bbbf9f18fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:37.326027 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-cde37eea-e2ee-478d-9b26-24bbbf9f18fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:37.332416 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cde37eea-e2ee-478d-9b26-24bbbf9f18fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:37.333609 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cde37eea-e2ee-478d-9b26-24bbbf9f18fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:37.334492 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cde37eea-e2ee-478d-9b26-24bbbf9f18fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:37.335354 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cde37eea-e2ee-478d-9b26-24bbbf9f18fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:37.336022 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cde37eea-e2ee-478d-9b26-24bbbf9f18fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:37.336601 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cde37eea-e2ee-478d-9b26-24bbbf9f18fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:37.337952 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-454b32ab-4d0d-4930-913f-d16316769cda tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1555 microversion: 2.1 time: 0.380841 Aug 17 23:47:37.353780 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 308/626] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:36 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1555 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:37.365080 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ccaf83b4-0017-481e-bdb3-1f7ffc23e796 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:37.365847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ccaf83b4-0017-481e-bdb3-1f7ffc23e796 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:37.373798 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccaf83b4-0017-481e-bdb3-1f7ffc23e796 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:37.374648 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccaf83b4-0017-481e-bdb3-1f7ffc23e796 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:37.375312 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccaf83b4-0017-481e-bdb3-1f7ffc23e796 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:37.376227 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccaf83b4-0017-481e-bdb3-1f7ffc23e796 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:37.376687 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccaf83b4-0017-481e-bdb3-1f7ffc23e796 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:37.377146 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccaf83b4-0017-481e-bdb3-1f7ffc23e796 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:37.466483 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ccaf83b4-0017-481e-bdb3-1f7ffc23e796 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107469 Aug 17 23:47:37.467375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 309/627] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Aug 17 23:47:37 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:47:37.472170 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1aec9234-2abd-4940-9e86-e1ba4ea5e801 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:37.472939 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-1aec9234-2abd-4940-9e86-e1ba4ea5e801 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:37.480795 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1aec9234-2abd-4940-9e86-e1ba4ea5e801 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:37.481294 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1aec9234-2abd-4940-9e86-e1ba4ea5e801 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:37.482772 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1aec9234-2abd-4940-9e86-e1ba4ea5e801 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:37.483491 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1aec9234-2abd-4940-9e86-e1ba4ea5e801 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:37.483953 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1aec9234-2abd-4940-9e86-e1ba4ea5e801 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:37.484413 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1aec9234-2abd-4940-9e86-e1ba4ea5e801 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:37.541252 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-cde37eea-e2ee-478d-9b26-24bbbf9f18fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:37.551391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-cde37eea-e2ee-478d-9b26-24bbbf9f18fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1260 microversion: 2.1 time: 0.230996 Aug 17 23:47:37.552394 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 319/628] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:37 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1260 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:37.634317 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1aec9234-2abd-4940-9e86-e1ba4ea5e801 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:37.638044 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=100 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:47:37.643120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-1aec9234-2abd-4940-9e86-e1ba4ea5e801 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.174517 Aug 17 23:47:37.643912 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 310/629] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:37 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:38.345490 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-2609bdef-1baa-4557-b01d-ed8218944b01 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:38.346012 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-2609bdef-1baa-4557-b01d-ed8218944b01 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:38.352799 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2609bdef-1baa-4557-b01d-ed8218944b01 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:38.353279 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2609bdef-1baa-4557-b01d-ed8218944b01 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:38.353713 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2609bdef-1baa-4557-b01d-ed8218944b01 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:38.354396 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2609bdef-1baa-4557-b01d-ed8218944b01 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:38.354844 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2609bdef-1baa-4557-b01d-ed8218944b01 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:38.355263 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2609bdef-1baa-4557-b01d-ed8218944b01 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:38.572990 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-99c07eb2-9bba-4f45-b845-efb4f62325ba tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:38.573595 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-99c07eb2-9bba-4f45-b845-efb4f62325ba tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:38.580389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-99c07eb2-9bba-4f45-b845-efb4f62325ba tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:38.580879 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-99c07eb2-9bba-4f45-b845-efb4f62325ba tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:38.581313 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-99c07eb2-9bba-4f45-b845-efb4f62325ba tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:38.582009 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-99c07eb2-9bba-4f45-b845-efb4f62325ba tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:38.582459 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-99c07eb2-9bba-4f45-b845-efb4f62325ba tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:38.582877 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-99c07eb2-9bba-4f45-b845-efb4f62325ba tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:38.602277 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-2609bdef-1baa-4557-b01d-ed8218944b01 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:38.613850 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-2609bdef-1baa-4557-b01d-ed8218944b01 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:38.616231 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-2609bdef-1baa-4557-b01d-ed8218944b01 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:38.618191 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-2609bdef-1baa-4557-b01d-ed8218944b01 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.276153 Aug 17 23:47:38.618894 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 320/630] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:38 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:38.664857 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-4c66c4ab-4e76-4589-85f1-bd683d479f9f tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:38.665477 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-4c66c4ab-4e76-4589-85f1-bd683d479f9f tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:38.671632 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4c66c4ab-4e76-4589-85f1-bd683d479f9f tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:38.672149 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4c66c4ab-4e76-4589-85f1-bd683d479f9f tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:38.672579 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4c66c4ab-4e76-4589-85f1-bd683d479f9f tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:38.673268 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4c66c4ab-4e76-4589-85f1-bd683d479f9f tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:38.673716 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4c66c4ab-4e76-4589-85f1-bd683d479f9f tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:38.674133 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4c66c4ab-4e76-4589-85f1-bd683d479f9f tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:38.734988 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-99c07eb2-9bba-4f45-b845-efb4f62325ba tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:38.744675 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-99c07eb2-9bba-4f45-b845-efb4f62325ba tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1260 microversion: 2.1 time: 0.175418 Aug 17 23:47:38.745535 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 311/631] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:38 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:38.785660 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-b5a69f31-97b6-4d6e-9632-3dd861d491db req-f79ef5c9-c675-4c11-916f-b3684069ef1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3", "tag": "dfa9d9dc-5ba7-401c-ba5e-15d6312bb95f"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:47:38.795912 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-b5a69f31-97b6-4d6e-9632-3dd861d491db req-f79ef5c9-c675-4c11-916f-b3684069ef1e service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:38.796646 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-b5a69f31-97b6-4d6e-9632-3dd861d491db req-f79ef5c9-c675-4c11-916f-b3684069ef1e service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:38.797088 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-b5a69f31-97b6-4d6e-9632-3dd861d491db req-f79ef5c9-c675-4c11-916f-b3684069ef1e service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:38.808650 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-b5a69f31-97b6-4d6e-9632-3dd861d491db req-f79ef5c9-c675-4c11-916f-b3684069ef1e service nova] Creating event network-changed:dfa9d9dc-5ba7-401c-ba5e-15d6312bb95f for instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 on hv-cinder-82002 Aug 17 23:47:38.814032 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-b5a69f31-97b6-4d6e-9632-3dd861d491db req-f79ef5c9-c675-4c11-916f-b3684069ef1e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032005 Aug 17 23:47:38.814634 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 312/632] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:47:38.849608 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-4c66c4ab-4e76-4589-85f1-bd683d479f9f tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:38.857655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-4c66c4ab-4e76-4589-85f1-bd683d479f9f tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.197582 Aug 17 23:47:38.858212 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 321/633] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:38 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:39.643741 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-fdd8ae86-43aa-4dc1-a3c5-eeba33019494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:39.644564 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-fdd8ae86-43aa-4dc1-a3c5-eeba33019494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:39.651151 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fdd8ae86-43aa-4dc1-a3c5-eeba33019494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:39.651645 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fdd8ae86-43aa-4dc1-a3c5-eeba33019494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:39.652336 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fdd8ae86-43aa-4dc1-a3c5-eeba33019494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:39.653043 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fdd8ae86-43aa-4dc1-a3c5-eeba33019494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:39.653501 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fdd8ae86-43aa-4dc1-a3c5-eeba33019494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:39.653925 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fdd8ae86-43aa-4dc1-a3c5-eeba33019494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:39.765372 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-5257ba89-124e-4781-8b00-dd18a186dcf0 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:39.766762 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-5257ba89-124e-4781-8b00-dd18a186dcf0 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:39.773672 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5257ba89-124e-4781-8b00-dd18a186dcf0 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:39.774304 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5257ba89-124e-4781-8b00-dd18a186dcf0 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:39.774977 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5257ba89-124e-4781-8b00-dd18a186dcf0 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:39.775787 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5257ba89-124e-4781-8b00-dd18a186dcf0 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:39.776922 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5257ba89-124e-4781-8b00-dd18a186dcf0 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:39.776922 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5257ba89-124e-4781-8b00-dd18a186dcf0 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:39.796894 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-fdd8ae86-43aa-4dc1-a3c5-eeba33019494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:39.806529 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-fdd8ae86-43aa-4dc1-a3c5-eeba33019494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:39.808246 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-fdd8ae86-43aa-4dc1-a3c5-eeba33019494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:39.809455 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-fdd8ae86-43aa-4dc1-a3c5-eeba33019494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.170749 Aug 17 23:47:39.810027 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 313/634] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:39 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:47:39.879400 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-8330ee7b-e425-49f8-a4fa-2d54ab84e5ea tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:39.880058 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-8330ee7b-e425-49f8-a4fa-2d54ab84e5ea tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:39.886027 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8330ee7b-e425-49f8-a4fa-2d54ab84e5ea tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:39.886515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8330ee7b-e425-49f8-a4fa-2d54ab84e5ea tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:39.886953 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8330ee7b-e425-49f8-a4fa-2d54ab84e5ea tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:39.887655 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8330ee7b-e425-49f8-a4fa-2d54ab84e5ea tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:39.888152 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8330ee7b-e425-49f8-a4fa-2d54ab84e5ea tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:39.888573 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8330ee7b-e425-49f8-a4fa-2d54ab84e5ea tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:39.922892 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5257ba89-124e-4781-8b00-dd18a186dcf0 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:39.931249 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-5257ba89-124e-4781-8b00-dd18a186dcf0 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1260 microversion: 2.1 time: 0.169880 Aug 17 23:47:39.931922 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 322/635] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:39 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:40.017264 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8330ee7b-e425-49f8-a4fa-2d54ab84e5ea tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:40.024726 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-8330ee7b-e425-49f8-a4fa-2d54ab84e5ea tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.149236 Aug 17 23:47:40.025283 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 314/636] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:39 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:40.833362 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a4b5b98c-7048-483f-b648-35fd96250649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:40.833978 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a4b5b98c-7048-483f-b648-35fd96250649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:40.840963 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a4b5b98c-7048-483f-b648-35fd96250649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:40.841442 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a4b5b98c-7048-483f-b648-35fd96250649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:40.841877 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a4b5b98c-7048-483f-b648-35fd96250649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:40.842564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a4b5b98c-7048-483f-b648-35fd96250649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:40.843019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a4b5b98c-7048-483f-b648-35fd96250649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:40.843443 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a4b5b98c-7048-483f-b648-35fd96250649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:40.952400 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-18e6e43c-5762-431a-8e37-a28fd15a2fcd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:40.953012 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-18e6e43c-5762-431a-8e37-a28fd15a2fcd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:40.959209 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-18e6e43c-5762-431a-8e37-a28fd15a2fcd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:40.959695 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-18e6e43c-5762-431a-8e37-a28fd15a2fcd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:40.960174 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-18e6e43c-5762-431a-8e37-a28fd15a2fcd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:40.961102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-18e6e43c-5762-431a-8e37-a28fd15a2fcd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:40.961672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-18e6e43c-5762-431a-8e37-a28fd15a2fcd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:40.962104 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-18e6e43c-5762-431a-8e37-a28fd15a2fcd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:40.973912 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a4b5b98c-7048-483f-b648-35fd96250649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:40.982100 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a4b5b98c-7048-483f-b648-35fd96250649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:40.983602 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a4b5b98c-7048-483f-b648-35fd96250649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:40.985027 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a4b5b98c-7048-483f-b648-35fd96250649 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.155527 Aug 17 23:47:40.986068 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 323/637] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:40 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:41.045634 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d902a4a9-c09d-4c17-be20-1ae80f81647e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:41.046259 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d902a4a9-c09d-4c17-be20-1ae80f81647e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:41.052151 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d902a4a9-c09d-4c17-be20-1ae80f81647e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:41.052638 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d902a4a9-c09d-4c17-be20-1ae80f81647e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:41.053079 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d902a4a9-c09d-4c17-be20-1ae80f81647e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:41.053779 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d902a4a9-c09d-4c17-be20-1ae80f81647e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:41.054238 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d902a4a9-c09d-4c17-be20-1ae80f81647e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:41.055173 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d902a4a9-c09d-4c17-be20-1ae80f81647e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:41.106853 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-18e6e43c-5762-431a-8e37-a28fd15a2fcd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:41.114445 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-18e6e43c-5762-431a-8e37-a28fd15a2fcd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1260 microversion: 2.1 time: 0.165992 Aug 17 23:47:41.115013 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 315/638] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:40 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:41.191361 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d902a4a9-c09d-4c17-be20-1ae80f81647e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:41.200722 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d902a4a9-c09d-4c17-be20-1ae80f81647e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1358 microversion: 2.1 time: 0.158834 Aug 17 23:47:41.208049 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 324/639] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:41 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:42.008541 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2f98f9f5-2a49-42de-8826-c1c22d3f2b34 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:42.009218 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2f98f9f5-2a49-42de-8826-c1c22d3f2b34 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:42.016326 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2f98f9f5-2a49-42de-8826-c1c22d3f2b34 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:42.016917 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2f98f9f5-2a49-42de-8826-c1c22d3f2b34 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:42.017391 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2f98f9f5-2a49-42de-8826-c1c22d3f2b34 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:42.018257 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2f98f9f5-2a49-42de-8826-c1c22d3f2b34 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:42.019411 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2f98f9f5-2a49-42de-8826-c1c22d3f2b34 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:42.019858 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2f98f9f5-2a49-42de-8826-c1c22d3f2b34 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:42.135654 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-62681163-67c2-4d31-ac93-e1770689824a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:42.136354 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-62681163-67c2-4d31-ac93-e1770689824a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:42.142718 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-62681163-67c2-4d31-ac93-e1770689824a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:42.143202 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-62681163-67c2-4d31-ac93-e1770689824a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:42.143636 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-62681163-67c2-4d31-ac93-e1770689824a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:42.144350 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-62681163-67c2-4d31-ac93-e1770689824a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:42.144807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-62681163-67c2-4d31-ac93-e1770689824a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:42.145338 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-62681163-67c2-4d31-ac93-e1770689824a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:42.153588 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2f98f9f5-2a49-42de-8826-c1c22d3f2b34 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:42.162069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2f98f9f5-2a49-42de-8826-c1c22d3f2b34 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:42.163646 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2f98f9f5-2a49-42de-8826-c1c22d3f2b34 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:42.164826 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2f98f9f5-2a49-42de-8826-c1c22d3f2b34 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1744 microversion: 2.20 time: 0.160829 Aug 17 23:47:42.165379 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 316/640] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:42 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:42.221633 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-dccccc24-7c06-48a1-9f4e-c1274a9ad21b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:42.222378 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-dccccc24-7c06-48a1-9f4e-c1274a9ad21b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:42.228273 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dccccc24-7c06-48a1-9f4e-c1274a9ad21b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:42.228762 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dccccc24-7c06-48a1-9f4e-c1274a9ad21b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:42.229202 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dccccc24-7c06-48a1-9f4e-c1274a9ad21b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:42.229907 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dccccc24-7c06-48a1-9f4e-c1274a9ad21b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:42.230365 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dccccc24-7c06-48a1-9f4e-c1274a9ad21b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:42.230792 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dccccc24-7c06-48a1-9f4e-c1274a9ad21b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:42.275254 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-62681163-67c2-4d31-ac93-e1770689824a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:42.282795 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-62681163-67c2-4d31-ac93-e1770689824a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1260 microversion: 2.1 time: 0.151501 Aug 17 23:47:42.283359 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 325/641] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:42 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:42.359148 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-dccccc24-7c06-48a1-9f4e-c1274a9ad21b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:42.366583 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-dccccc24-7c06-48a1-9f4e-c1274a9ad21b tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1548 microversion: 2.1 time: 0.148941 Aug 17 23:47:42.367150 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 317/642] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:42 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:42.387563 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f2530a59-4f3c-4cc2-b7d5-6cb2454e9737 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:42.388230 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f2530a59-4f3c-4cc2-b7d5-6cb2454e9737 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:42.394006 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2530a59-4f3c-4cc2-b7d5-6cb2454e9737 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:42.394481 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2530a59-4f3c-4cc2-b7d5-6cb2454e9737 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:42.394920 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2530a59-4f3c-4cc2-b7d5-6cb2454e9737 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:42.395595 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2530a59-4f3c-4cc2-b7d5-6cb2454e9737 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:42.396074 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2530a59-4f3c-4cc2-b7d5-6cb2454e9737 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:42.396495 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2530a59-4f3c-4cc2-b7d5-6cb2454e9737 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:42.531443 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f2530a59-4f3c-4cc2-b7d5-6cb2454e9737 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:42.539178 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f2530a59-4f3c-4cc2-b7d5-6cb2454e9737 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1548 microversion: 2.1 time: 0.156065 Aug 17 23:47:42.539750 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 326/643] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:42 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:42.559142 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3a0f5b65-3956-4dd3-83e6-a17aee46ed43 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:42.563937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3a0f5b65-3956-4dd3-83e6-a17aee46ed43 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:42.564732 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3a0f5b65-3956-4dd3-83e6-a17aee46ed43 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Searching by: {'deleted': False, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea'} {{(pid=131395) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 17 23:47:42.571929 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3a0f5b65-3956-4dd3-83e6-a17aee46ed43 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:42.572446 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3a0f5b65-3956-4dd3-83e6-a17aee46ed43 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:42.572883 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3a0f5b65-3956-4dd3-83e6-a17aee46ed43 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:42.573611 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3a0f5b65-3956-4dd3-83e6-a17aee46ed43 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:42.574070 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3a0f5b65-3956-4dd3-83e6-a17aee46ed43 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:42.574498 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3a0f5b65-3956-4dd3-83e6-a17aee46ed43 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:42.662175 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.multi_cell_list [None req-3a0f5b65-3956-4dd3-83e6-a17aee46ed43 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131395) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 17 23:47:42.754712 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3a0f5b65-3956-4dd3-83e6-a17aee46ed43 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.199910 Aug 17 23:47:42.755307 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 318/644] 10.222.0.26 () {58 vars in 1125 bytes} [Wed Aug 17 23:47:42 2022] GET /compute/v2.1/servers => generated 342 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:47:42.766918 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-0fcff6d7-d71d-468d-8c60-075d4ef10fd6 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:42.767539 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-0fcff6d7-d71d-468d-8c60-075d4ef10fd6 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:42.774025 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0fcff6d7-d71d-468d-8c60-075d4ef10fd6 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:42.774526 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0fcff6d7-d71d-468d-8c60-075d4ef10fd6 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:42.774971 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0fcff6d7-d71d-468d-8c60-075d4ef10fd6 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:42.775670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0fcff6d7-d71d-468d-8c60-075d4ef10fd6 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:42.776174 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0fcff6d7-d71d-468d-8c60-075d4ef10fd6 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:42.776608 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0fcff6d7-d71d-468d-8c60-075d4ef10fd6 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:42.914587 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0fcff6d7-d71d-468d-8c60-075d4ef10fd6 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:42.922264 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-0fcff6d7-d71d-468d-8c60-075d4ef10fd6 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1548 microversion: 2.1 time: 0.159143 Aug 17 23:47:42.923046 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 327/645] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:42 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:43.187757 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3ebb3af1-a483-4b71-afa5-f6291d2ffbe6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:43.188418 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3ebb3af1-a483-4b71-afa5-f6291d2ffbe6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:43.196187 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3ebb3af1-a483-4b71-afa5-f6291d2ffbe6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:43.196684 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3ebb3af1-a483-4b71-afa5-f6291d2ffbe6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:43.197121 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3ebb3af1-a483-4b71-afa5-f6291d2ffbe6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:43.198555 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3ebb3af1-a483-4b71-afa5-f6291d2ffbe6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:43.199022 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3ebb3af1-a483-4b71-afa5-f6291d2ffbe6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:43.199500 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3ebb3af1-a483-4b71-afa5-f6291d2ffbe6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:43.302562 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e9d38178-f82c-4adc-b45c-d0dbf8ded897 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:43.303289 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e9d38178-f82c-4adc-b45c-d0dbf8ded897 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:43.309738 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e9d38178-f82c-4adc-b45c-d0dbf8ded897 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:43.310227 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e9d38178-f82c-4adc-b45c-d0dbf8ded897 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:43.310667 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e9d38178-f82c-4adc-b45c-d0dbf8ded897 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:43.311358 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e9d38178-f82c-4adc-b45c-d0dbf8ded897 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:43.311819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e9d38178-f82c-4adc-b45c-d0dbf8ded897 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:43.312297 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e9d38178-f82c-4adc-b45c-d0dbf8ded897 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:43.343843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3ebb3af1-a483-4b71-afa5-f6291d2ffbe6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:43.353196 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3ebb3af1-a483-4b71-afa5-f6291d2ffbe6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:43.354847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3ebb3af1-a483-4b71-afa5-f6291d2ffbe6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:43.356190 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3ebb3af1-a483-4b71-afa5-f6291d2ffbe6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1744 microversion: 2.20 time: 0.172287 Aug 17 23:47:43.356861 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 319/646] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:43 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:43.445128 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e9d38178-f82c-4adc-b45c-d0dbf8ded897 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:43.454294 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e9d38178-f82c-4adc-b45c-d0dbf8ded897 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1260 microversion: 2.1 time: 0.155187 Aug 17 23:47:43.454630 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 328/647] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:43 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:44.378808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-382b87c2-53f4-4127-9b73-b5eda820bf85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:44.379413 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-382b87c2-53f4-4127-9b73-b5eda820bf85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:44.385889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-382b87c2-53f4-4127-9b73-b5eda820bf85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:44.386363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-382b87c2-53f4-4127-9b73-b5eda820bf85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:44.386793 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-382b87c2-53f4-4127-9b73-b5eda820bf85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:44.387464 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-382b87c2-53f4-4127-9b73-b5eda820bf85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:44.387924 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-382b87c2-53f4-4127-9b73-b5eda820bf85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:44.388503 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-382b87c2-53f4-4127-9b73-b5eda820bf85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:44.474593 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-6883d119-8bd3-4efe-8226-23dd87c707a7 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:44.475211 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-6883d119-8bd3-4efe-8226-23dd87c707a7 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:44.482818 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6883d119-8bd3-4efe-8226-23dd87c707a7 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:44.483303 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6883d119-8bd3-4efe-8226-23dd87c707a7 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:44.483739 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6883d119-8bd3-4efe-8226-23dd87c707a7 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:44.484455 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6883d119-8bd3-4efe-8226-23dd87c707a7 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:44.484913 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6883d119-8bd3-4efe-8226-23dd87c707a7 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:44.485335 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6883d119-8bd3-4efe-8226-23dd87c707a7 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:44.522227 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-382b87c2-53f4-4127-9b73-b5eda820bf85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:44.530643 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-382b87c2-53f4-4127-9b73-b5eda820bf85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:44.532176 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-382b87c2-53f4-4127-9b73-b5eda820bf85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:44.533342 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-382b87c2-53f4-4127-9b73-b5eda820bf85 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1744 microversion: 2.20 time: 0.158430 Aug 17 23:47:44.547985 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 320/648] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:44 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:44.622706 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-6883d119-8bd3-4efe-8226-23dd87c707a7 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:44.630154 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-6883d119-8bd3-4efe-8226-23dd87c707a7 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1260 microversion: 2.1 time: 0.159344 Aug 17 23:47:44.630712 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 329/649] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:44 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:44.903540 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-750da4bc-7621-4684-9f39-a6d2458198dd req-35f81937-5474-4e98-83fd-d0872f16ea97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abc34597-7782-4715-86c3-6a940ecde323", "name": "network-vif-plugged", "status": "completed", "tag": "bce8dab3-ded2-46e7-a72a-7a52eb3c9201"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:47:44.908516 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=100 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:47:44.914999 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-750da4bc-7621-4684-9f39-a6d2458198dd req-35f81937-5474-4e98-83fd-d0872f16ea97 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:44.915487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-750da4bc-7621-4684-9f39-a6d2458198dd req-35f81937-5474-4e98-83fd-d0872f16ea97 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:44.915914 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-750da4bc-7621-4684-9f39-a6d2458198dd req-35f81937-5474-4e98-83fd-d0872f16ea97 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:44.927208 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-750da4bc-7621-4684-9f39-a6d2458198dd req-35f81937-5474-4e98-83fd-d0872f16ea97 service nova] Creating event network-vif-plugged:bce8dab3-ded2-46e7-a72a-7a52eb3c9201 for instance abc34597-7782-4715-86c3-6a940ecde323 on hv-cinder-82002 Aug 17 23:47:44.932090 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-750da4bc-7621-4684-9f39-a6d2458198dd req-35f81937-5474-4e98-83fd-d0872f16ea97 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032202 Aug 17 23:47:44.932680 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 321/650] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:47:45.519013 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-eb2290b4-cb63-40b0-a040-1eb93e215ece tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf86aff8-f4dd-49fe-aac3-4c7b91c9bdb5"}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:47:45.521438 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-eb2290b4-cb63-40b0-a040-1eb93e215ece tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:45.527746 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-eb2290b4-cb63-40b0-a040-1eb93e215ece tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:45.528258 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-eb2290b4-cb63-40b0-a040-1eb93e215ece tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:45.528692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-eb2290b4-cb63-40b0-a040-1eb93e215ece tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:45.529366 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-eb2290b4-cb63-40b0-a040-1eb93e215ece tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:45.529818 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-eb2290b4-cb63-40b0-a040-1eb93e215ece tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:45.530235 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-eb2290b4-cb63-40b0-a040-1eb93e215ece tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:45.558653 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-8652a819-6e9f-4c19-b393-17d917954e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:45.559583 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-8652a819-6e9f-4c19-b393-17d917954e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:45.566142 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8652a819-6e9f-4c19-b393-17d917954e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:45.566725 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8652a819-6e9f-4c19-b393-17d917954e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:45.567267 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8652a819-6e9f-4c19-b393-17d917954e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:45.568084 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8652a819-6e9f-4c19-b393-17d917954e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:45.568548 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8652a819-6e9f-4c19-b393-17d917954e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:45.568983 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8652a819-6e9f-4c19-b393-17d917954e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:45.703072 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8652a819-6e9f-4c19-b393-17d917954e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:45.712172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8652a819-6e9f-4c19-b393-17d917954e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:45.713691 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8652a819-6e9f-4c19-b393-17d917954e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:45.714851 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-8652a819-6e9f-4c19-b393-17d917954e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1744 microversion: 2.20 time: 0.161607 Aug 17 23:47:45.715418 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 322/651] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:45 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:47:45.724932 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-eea14bf7-b323-48c2-a07b-b758d52c4855 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:45.725538 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-eea14bf7-b323-48c2-a07b-b758d52c4855 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:45.731531 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eea14bf7-b323-48c2-a07b-b758d52c4855 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:45.732054 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eea14bf7-b323-48c2-a07b-b758d52c4855 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:45.732521 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eea14bf7-b323-48c2-a07b-b758d52c4855 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:45.733222 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eea14bf7-b323-48c2-a07b-b758d52c4855 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:45.733673 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eea14bf7-b323-48c2-a07b-b758d52c4855 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:45.734095 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eea14bf7-b323-48c2-a07b-b758d52c4855 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:45.836882 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-eb2290b4-cb63-40b0-a040-1eb93e215ece tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "POST /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321366 Aug 17 23:47:45.837501 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 330/652] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 17 23:47:45 2022] POST /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:47:45.872435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-eea14bf7-b323-48c2-a07b-b758d52c4855 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:45.879800 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-eea14bf7-b323-48c2-a07b-b758d52c4855 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1260 microversion: 2.1 time: 0.158514 Aug 17 23:47:45.880391 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 323/653] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:45 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:46.739776 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-afebc27f-3013-48dc-a4df-4bf389cb8e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:46.740543 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-afebc27f-3013-48dc-a4df-4bf389cb8e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:46.747394 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-afebc27f-3013-48dc-a4df-4bf389cb8e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:46.747875 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-afebc27f-3013-48dc-a4df-4bf389cb8e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:46.748417 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-afebc27f-3013-48dc-a4df-4bf389cb8e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:46.749138 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-afebc27f-3013-48dc-a4df-4bf389cb8e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:46.749586 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-afebc27f-3013-48dc-a4df-4bf389cb8e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:46.750006 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-afebc27f-3013-48dc-a4df-4bf389cb8e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:46.879293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-afebc27f-3013-48dc-a4df-4bf389cb8e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:46.887851 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-afebc27f-3013-48dc-a4df-4bf389cb8e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:46.889386 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-afebc27f-3013-48dc-a4df-4bf389cb8e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:46.890547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-afebc27f-3013-48dc-a4df-4bf389cb8e80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1744 microversion: 2.20 time: 0.155711 Aug 17 23:47:46.891104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 331/654] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:46 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:46.901137 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9fa39bba-c245-4dac-99a4-f0eb512808db tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:46.901907 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9fa39bba-c245-4dac-99a4-f0eb512808db tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:46.908934 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9fa39bba-c245-4dac-99a4-f0eb512808db tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:46.909494 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9fa39bba-c245-4dac-99a4-f0eb512808db tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:46.910004 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9fa39bba-c245-4dac-99a4-f0eb512808db tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:46.911003 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9fa39bba-c245-4dac-99a4-f0eb512808db tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:46.911844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9fa39bba-c245-4dac-99a4-f0eb512808db tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:46.912437 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9fa39bba-c245-4dac-99a4-f0eb512808db tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:47.047753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9fa39bba-c245-4dac-99a4-f0eb512808db tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:47.055858 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9fa39bba-c245-4dac-99a4-f0eb512808db tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1260 microversion: 2.1 time: 0.159452 Aug 17 23:47:47.056457 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 324/655] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:46 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:47.915465 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f19bcb0e-d58b-42ee-be90-c84c8d992160 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:47.916097 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f19bcb0e-d58b-42ee-be90-c84c8d992160 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:47.922250 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f19bcb0e-d58b-42ee-be90-c84c8d992160 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:47.922728 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f19bcb0e-d58b-42ee-be90-c84c8d992160 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:47.923168 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f19bcb0e-d58b-42ee-be90-c84c8d992160 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:47.923884 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f19bcb0e-d58b-42ee-be90-c84c8d992160 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:47.924365 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f19bcb0e-d58b-42ee-be90-c84c8d992160 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:47.924783 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f19bcb0e-d58b-42ee-be90-c84c8d992160 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:48.061038 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f19bcb0e-d58b-42ee-be90-c84c8d992160 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:48.068931 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f19bcb0e-d58b-42ee-be90-c84c8d992160 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:48.071235 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f19bcb0e-d58b-42ee-be90-c84c8d992160 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:48.072462 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f19bcb0e-d58b-42ee-be90-c84c8d992160 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1744 microversion: 2.20 time: 0.161777 Aug 17 23:47:48.073080 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 332/656] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:47 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:48.075856 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-23ccb256-af2a-456a-a0ff-3d01435ddef5 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:48.076529 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-23ccb256-af2a-456a-a0ff-3d01435ddef5 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:48.082855 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23ccb256-af2a-456a-a0ff-3d01435ddef5 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:48.083335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23ccb256-af2a-456a-a0ff-3d01435ddef5 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:48.083774 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23ccb256-af2a-456a-a0ff-3d01435ddef5 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:48.084517 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23ccb256-af2a-456a-a0ff-3d01435ddef5 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:48.084976 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23ccb256-af2a-456a-a0ff-3d01435ddef5 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:48.085398 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23ccb256-af2a-456a-a0ff-3d01435ddef5 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:48.219526 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-23ccb256-af2a-456a-a0ff-3d01435ddef5 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:48.227605 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-23ccb256-af2a-456a-a0ff-3d01435ddef5 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1260 microversion: 2.1 time: 0.155605 Aug 17 23:47:48.228137 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 325/657] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:48 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:49.098465 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-4b6d0bd3-4d8e-47f4-b9f7-973a0867ba43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:49.099512 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-4b6d0bd3-4d8e-47f4-b9f7-973a0867ba43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:49.109620 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4b6d0bd3-4d8e-47f4-b9f7-973a0867ba43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:49.110100 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4b6d0bd3-4d8e-47f4-b9f7-973a0867ba43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:49.110531 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4b6d0bd3-4d8e-47f4-b9f7-973a0867ba43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:49.111220 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4b6d0bd3-4d8e-47f4-b9f7-973a0867ba43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:49.111666 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4b6d0bd3-4d8e-47f4-b9f7-973a0867ba43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:49.112114 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4b6d0bd3-4d8e-47f4-b9f7-973a0867ba43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:49.239137 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-4b6d0bd3-4d8e-47f4-b9f7-973a0867ba43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:49.241454 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:47:49.248117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ea477171-e60c-494d-a193-5a4384a56488 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:49.248727 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ea477171-e60c-494d-a193-5a4384a56488 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:49.249989 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-4b6d0bd3-4d8e-47f4-b9f7-973a0867ba43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:49.251479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-4b6d0bd3-4d8e-47f4-b9f7-973a0867ba43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:49.252653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-4b6d0bd3-4d8e-47f4-b9f7-973a0867ba43 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1744 microversion: 2.20 time: 0.160594 Aug 17 23:47:49.253203 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 333/658] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:49 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:47:49.254762 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ea477171-e60c-494d-a193-5a4384a56488 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:49.255252 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ea477171-e60c-494d-a193-5a4384a56488 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:49.255719 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ea477171-e60c-494d-a193-5a4384a56488 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:49.256499 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ea477171-e60c-494d-a193-5a4384a56488 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:49.256953 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ea477171-e60c-494d-a193-5a4384a56488 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:49.257401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ea477171-e60c-494d-a193-5a4384a56488 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:49.385008 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ea477171-e60c-494d-a193-5a4384a56488 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:49.392249 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ea477171-e60c-494d-a193-5a4384a56488 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1260 microversion: 2.1 time: 0.147820 Aug 17 23:47:49.392804 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 326/659] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:49 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:49.566800 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-94ea602b-754c-45f5-9a7b-718a3db1bdea req-0bbadc5f-176f-4be7-ad4b-10293a995152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93126672-4679-41e5-bfbd-f06836afac17", "name": "network-vif-plugged", "status": "completed", "tag": "da8d102a-c017-4932-bfb8-b3ef13097d11"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:47:49.580298 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-94ea602b-754c-45f5-9a7b-718a3db1bdea req-0bbadc5f-176f-4be7-ad4b-10293a995152 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:49.580771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-94ea602b-754c-45f5-9a7b-718a3db1bdea req-0bbadc5f-176f-4be7-ad4b-10293a995152 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:49.581204 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-94ea602b-754c-45f5-9a7b-718a3db1bdea req-0bbadc5f-176f-4be7-ad4b-10293a995152 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:49.592446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-94ea602b-754c-45f5-9a7b-718a3db1bdea req-0bbadc5f-176f-4be7-ad4b-10293a995152 service nova] Creating event network-vif-plugged:da8d102a-c017-4932-bfb8-b3ef13097d11 for instance 93126672-4679-41e5-bfbd-f06836afac17 on hv-cinder-82002 Aug 17 23:47:49.597454 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-94ea602b-754c-45f5-9a7b-718a3db1bdea req-0bbadc5f-176f-4be7-ad4b-10293a995152 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034937 Aug 17 23:47:49.598036 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 334/660] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:47:50.275922 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-61dafb3a-2768-49e5-a6e9-7cd5290b029f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:50.276612 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-61dafb3a-2768-49e5-a6e9-7cd5290b029f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:50.283142 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-61dafb3a-2768-49e5-a6e9-7cd5290b029f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:50.283846 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-61dafb3a-2768-49e5-a6e9-7cd5290b029f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:50.284324 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-61dafb3a-2768-49e5-a6e9-7cd5290b029f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:50.285014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-61dafb3a-2768-49e5-a6e9-7cd5290b029f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:50.285466 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-61dafb3a-2768-49e5-a6e9-7cd5290b029f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:50.285887 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-61dafb3a-2768-49e5-a6e9-7cd5290b029f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:50.414866 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-df74f669-285b-4f82-9569-826fc48a47db tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:50.416350 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-df74f669-285b-4f82-9569-826fc48a47db tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:50.424841 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df74f669-285b-4f82-9569-826fc48a47db tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:50.425715 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df74f669-285b-4f82-9569-826fc48a47db tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:50.426490 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df74f669-285b-4f82-9569-826fc48a47db tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:50.427821 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df74f669-285b-4f82-9569-826fc48a47db tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:50.428711 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df74f669-285b-4f82-9569-826fc48a47db tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:50.429385 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df74f669-285b-4f82-9569-826fc48a47db tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:50.459984 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-61dafb3a-2768-49e5-a6e9-7cd5290b029f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:50.470569 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-61dafb3a-2768-49e5-a6e9-7cd5290b029f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:50.472410 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-61dafb3a-2768-49e5-a6e9-7cd5290b029f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:50.473924 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-61dafb3a-2768-49e5-a6e9-7cd5290b029f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1739 microversion: 2.20 time: 0.202390 Aug 17 23:47:50.474618 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 327/661] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:50 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:50.590464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-df74f669-285b-4f82-9569-826fc48a47db tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:50.598481 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-df74f669-285b-4f82-9569-826fc48a47db tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1260 microversion: 2.1 time: 0.189268 Aug 17 23:47:50.599557 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 335/662] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:50 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:51.498849 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3b3bcd84-0e79-4f04-9d1d-1260a2c519d5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:51.499463 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3b3bcd84-0e79-4f04-9d1d-1260a2c519d5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:51.507162 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b3bcd84-0e79-4f04-9d1d-1260a2c519d5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:51.507648 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b3bcd84-0e79-4f04-9d1d-1260a2c519d5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:51.508103 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b3bcd84-0e79-4f04-9d1d-1260a2c519d5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:51.508791 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b3bcd84-0e79-4f04-9d1d-1260a2c519d5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:51.509307 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b3bcd84-0e79-4f04-9d1d-1260a2c519d5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:51.509940 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b3bcd84-0e79-4f04-9d1d-1260a2c519d5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:51.530913 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=100 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:47:51.618742 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c5cae9cc-50fc-4fe7-807d-a8abef7673b6 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:51.619398 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c5cae9cc-50fc-4fe7-807d-a8abef7673b6 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:51.626050 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5cae9cc-50fc-4fe7-807d-a8abef7673b6 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:51.626784 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5cae9cc-50fc-4fe7-807d-a8abef7673b6 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:51.627405 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5cae9cc-50fc-4fe7-807d-a8abef7673b6 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:51.628315 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5cae9cc-50fc-4fe7-807d-a8abef7673b6 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:51.628940 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5cae9cc-50fc-4fe7-807d-a8abef7673b6 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:51.629373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5cae9cc-50fc-4fe7-807d-a8abef7673b6 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:51.644620 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3b3bcd84-0e79-4f04-9d1d-1260a2c519d5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:51.656182 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3b3bcd84-0e79-4f04-9d1d-1260a2c519d5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:51.658036 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3b3bcd84-0e79-4f04-9d1d-1260a2c519d5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:51.659213 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3b3bcd84-0e79-4f04-9d1d-1260a2c519d5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1739 microversion: 2.20 time: 0.164725 Aug 17 23:47:51.659775 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 328/663] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:51 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:51.782815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c5cae9cc-50fc-4fe7-807d-a8abef7673b6 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:51.791196 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c5cae9cc-50fc-4fe7-807d-a8abef7673b6 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1260 microversion: 2.1 time: 0.176208 Aug 17 23:47:51.791921 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 336/664] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:51 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:52.683560 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-467f9428-56e2-4d87-bf23-a57a52b8ad8a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:52.684261 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-467f9428-56e2-4d87-bf23-a57a52b8ad8a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:52.687798 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:47:52.692011 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-467f9428-56e2-4d87-bf23-a57a52b8ad8a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:52.692508 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-467f9428-56e2-4d87-bf23-a57a52b8ad8a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:52.692965 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-467f9428-56e2-4d87-bf23-a57a52b8ad8a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:52.693669 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-467f9428-56e2-4d87-bf23-a57a52b8ad8a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:52.694127 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-467f9428-56e2-4d87-bf23-a57a52b8ad8a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:52.705175 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-467f9428-56e2-4d87-bf23-a57a52b8ad8a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:52.812222 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-31f19702-b70f-49f7-8097-871c4b7fe7a9 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:52.813123 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-31f19702-b70f-49f7-8097-871c4b7fe7a9 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:52.820769 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-31f19702-b70f-49f7-8097-871c4b7fe7a9 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:52.821342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-31f19702-b70f-49f7-8097-871c4b7fe7a9 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:52.821956 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-31f19702-b70f-49f7-8097-871c4b7fe7a9 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:52.822783 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-31f19702-b70f-49f7-8097-871c4b7fe7a9 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:52.823542 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-31f19702-b70f-49f7-8097-871c4b7fe7a9 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:52.824385 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-31f19702-b70f-49f7-8097-871c4b7fe7a9 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:52.843288 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-467f9428-56e2-4d87-bf23-a57a52b8ad8a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:52.858000 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-467f9428-56e2-4d87-bf23-a57a52b8ad8a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:52.862915 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-467f9428-56e2-4d87-bf23-a57a52b8ad8a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:52.864748 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-467f9428-56e2-4d87-bf23-a57a52b8ad8a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1739 microversion: 2.20 time: 0.185726 Aug 17 23:47:52.869200 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 329/665] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:52 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:53.009730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-31f19702-b70f-49f7-8097-871c4b7fe7a9 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:53.017244 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-31f19702-b70f-49f7-8097-871c4b7fe7a9 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1260 microversion: 2.1 time: 0.208980 Aug 17 23:47:53.017807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 337/666] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:52 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1260 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:53.890656 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0603b683-07d7-4a5b-9d03-a65a653ea3bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:53.891366 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0603b683-07d7-4a5b-9d03-a65a653ea3bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:53.897750 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0603b683-07d7-4a5b-9d03-a65a653ea3bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:53.898243 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0603b683-07d7-4a5b-9d03-a65a653ea3bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:53.898686 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0603b683-07d7-4a5b-9d03-a65a653ea3bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:53.899388 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0603b683-07d7-4a5b-9d03-a65a653ea3bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:53.899850 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0603b683-07d7-4a5b-9d03-a65a653ea3bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:53.900309 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0603b683-07d7-4a5b-9d03-a65a653ea3bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:54.038565 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-bf202de7-f007-4faa-b89c-b237442f1d00 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:54.039768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-bf202de7-f007-4faa-b89c-b237442f1d00 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:54.050128 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bf202de7-f007-4faa-b89c-b237442f1d00 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:54.050549 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bf202de7-f007-4faa-b89c-b237442f1d00 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:54.050987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bf202de7-f007-4faa-b89c-b237442f1d00 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:54.051689 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bf202de7-f007-4faa-b89c-b237442f1d00 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:54.052181 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bf202de7-f007-4faa-b89c-b237442f1d00 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:54.052607 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bf202de7-f007-4faa-b89c-b237442f1d00 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:54.059868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0603b683-07d7-4a5b-9d03-a65a653ea3bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:54.069552 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0603b683-07d7-4a5b-9d03-a65a653ea3bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:54.074278 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0603b683-07d7-4a5b-9d03-a65a653ea3bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:54.075472 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0603b683-07d7-4a5b-9d03-a65a653ea3bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1739 microversion: 2.20 time: 0.188765 Aug 17 23:47:54.076060 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 330/667] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:53 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:54.193381 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-bf202de7-f007-4faa-b89c-b237442f1d00 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:54.201680 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-bf202de7-f007-4faa-b89c-b237442f1d00 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1444 microversion: 2.1 time: 0.167237 Aug 17 23:47:54.209516 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 338/668] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:54 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1444 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:47:54.221707 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-911e4562-41c2-4f69-9d2e-51054791e3bb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:54.222316 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-911e4562-41c2-4f69-9d2e-51054791e3bb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:54.229102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-911e4562-41c2-4f69-9d2e-51054791e3bb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:54.229702 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-911e4562-41c2-4f69-9d2e-51054791e3bb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:54.230270 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-911e4562-41c2-4f69-9d2e-51054791e3bb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:54.230965 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-911e4562-41c2-4f69-9d2e-51054791e3bb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:54.231608 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-911e4562-41c2-4f69-9d2e-51054791e3bb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:54.232055 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-911e4562-41c2-4f69-9d2e-51054791e3bb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:54.398844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-911e4562-41c2-4f69-9d2e-51054791e3bb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:54.417137 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-911e4562-41c2-4f69-9d2e-51054791e3bb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1444 microversion: 2.1 time: 0.196481 Aug 17 23:47:54.418062 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 331/669] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:54 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1444 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:54.681030 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-09039ad2-f713-4f5f-828e-539bd112c2e8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:54.682376 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-09039ad2-f713-4f5f-828e-539bd112c2e8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:54.706763 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-09039ad2-f713-4f5f-828e-539bd112c2e8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:54.710300 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-09039ad2-f713-4f5f-828e-539bd112c2e8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:54.712806 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-09039ad2-f713-4f5f-828e-539bd112c2e8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:54.715562 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-09039ad2-f713-4f5f-828e-539bd112c2e8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:54.717398 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-09039ad2-f713-4f5f-828e-539bd112c2e8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:54.718765 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-09039ad2-f713-4f5f-828e-539bd112c2e8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:54.884531 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-09039ad2-f713-4f5f-828e-539bd112c2e8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:54.893285 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-09039ad2-f713-4f5f-828e-539bd112c2e8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1594 microversion: 2.1 time: 0.218099 Aug 17 23:47:54.894077 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 339/670] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:47:54 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1594 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:47:55.098747 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2b1b5827-482c-402e-9cc9-d63dead961cf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:55.100482 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2b1b5827-482c-402e-9cc9-d63dead961cf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:55.107362 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2b1b5827-482c-402e-9cc9-d63dead961cf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:55.107856 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2b1b5827-482c-402e-9cc9-d63dead961cf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:55.118998 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2b1b5827-482c-402e-9cc9-d63dead961cf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:55.119973 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2b1b5827-482c-402e-9cc9-d63dead961cf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:55.120771 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2b1b5827-482c-402e-9cc9-d63dead961cf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:55.121217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2b1b5827-482c-402e-9cc9-d63dead961cf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:55.362348 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2b1b5827-482c-402e-9cc9-d63dead961cf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:55.375118 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2b1b5827-482c-402e-9cc9-d63dead961cf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:55.376645 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2b1b5827-482c-402e-9cc9-d63dead961cf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:55.377833 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2b1b5827-482c-402e-9cc9-d63dead961cf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1739 microversion: 2.20 time: 0.282927 Aug 17 23:47:55.383041 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 332/671] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:55 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:56.403774 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9122cfc6-1a19-41c7-8893-e96851416c2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:56.404417 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9122cfc6-1a19-41c7-8893-e96851416c2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:56.414267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9122cfc6-1a19-41c7-8893-e96851416c2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:56.415043 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9122cfc6-1a19-41c7-8893-e96851416c2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:56.415704 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9122cfc6-1a19-41c7-8893-e96851416c2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:56.416638 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9122cfc6-1a19-41c7-8893-e96851416c2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:56.417278 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9122cfc6-1a19-41c7-8893-e96851416c2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:56.418116 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9122cfc6-1a19-41c7-8893-e96851416c2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:56.693287 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9122cfc6-1a19-41c7-8893-e96851416c2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:56.716353 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9122cfc6-1a19-41c7-8893-e96851416c2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:56.729107 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9122cfc6-1a19-41c7-8893-e96851416c2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:56.730318 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9122cfc6-1a19-41c7-8893-e96851416c2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1739 microversion: 2.20 time: 0.330507 Aug 17 23:47:56.738676 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 340/672] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:56 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1739 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:56.894459 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-f80664f6-5435-4b8f-bf58-6318ab1f590e req-a4c6ebf7-c12e-4500-80a5-6feac6badec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93126672-4679-41e5-bfbd-f06836afac17", "tag": "da8d102a-c017-4932-bfb8-b3ef13097d11"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:47:56.920151 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-f80664f6-5435-4b8f-bf58-6318ab1f590e req-a4c6ebf7-c12e-4500-80a5-6feac6badec1 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:56.922503 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-f80664f6-5435-4b8f-bf58-6318ab1f590e req-a4c6ebf7-c12e-4500-80a5-6feac6badec1 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:56.923203 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-f80664f6-5435-4b8f-bf58-6318ab1f590e req-a4c6ebf7-c12e-4500-80a5-6feac6badec1 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:56.956796 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-f80664f6-5435-4b8f-bf58-6318ab1f590e req-a4c6ebf7-c12e-4500-80a5-6feac6badec1 service nova] Creating event network-changed:da8d102a-c017-4932-bfb8-b3ef13097d11 for instance 93126672-4679-41e5-bfbd-f06836afac17 on hv-cinder-82002 Aug 17 23:47:56.965708 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-f80664f6-5435-4b8f-bf58-6318ab1f590e req-a4c6ebf7-c12e-4500-80a5-6feac6badec1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075017 Aug 17 23:47:56.969841 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 333/673] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:47:57.569022 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-aac23a43-8a15-496c-ba17-52ba47190a35 req-835c421b-3d82-4d40-8428-980b91c4ff48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930c290f-5bb3-44fe-857d-9d5423eca017", "tag": "e95c1c30-368b-4623-86e2-0d608e9a186a"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:47:57.592437 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-aac23a43-8a15-496c-ba17-52ba47190a35 req-835c421b-3d82-4d40-8428-980b91c4ff48 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:57.597325 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-aac23a43-8a15-496c-ba17-52ba47190a35 req-835c421b-3d82-4d40-8428-980b91c4ff48 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:57.598069 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-aac23a43-8a15-496c-ba17-52ba47190a35 req-835c421b-3d82-4d40-8428-980b91c4ff48 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:57.638270 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-aac23a43-8a15-496c-ba17-52ba47190a35 req-835c421b-3d82-4d40-8428-980b91c4ff48 service nova] Creating event network-changed:e95c1c30-368b-4623-86e2-0d608e9a186a for instance 930c290f-5bb3-44fe-857d-9d5423eca017 on hv-cinder-82002 Aug 17 23:47:57.661707 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-aac23a43-8a15-496c-ba17-52ba47190a35 req-835c421b-3d82-4d40-8428-980b91c4ff48 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090731 Aug 17 23:47:57.662796 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 341/674] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:47:57.766278 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-90c2cf77-e71c-474d-894d-9e899e248ca4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:57.768529 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-90c2cf77-e71c-474d-894d-9e899e248ca4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:57.785970 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90c2cf77-e71c-474d-894d-9e899e248ca4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:57.789141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90c2cf77-e71c-474d-894d-9e899e248ca4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:57.789832 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90c2cf77-e71c-474d-894d-9e899e248ca4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:57.795294 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90c2cf77-e71c-474d-894d-9e899e248ca4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:57.796794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90c2cf77-e71c-474d-894d-9e899e248ca4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:57.799514 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90c2cf77-e71c-474d-894d-9e899e248ca4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:58.435117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-90c2cf77-e71c-474d-894d-9e899e248ca4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:58.454216 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-90c2cf77-e71c-474d-894d-9e899e248ca4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:58.472545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-90c2cf77-e71c-474d-894d-9e899e248ca4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:58.483811 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-90c2cf77-e71c-474d-894d-9e899e248ca4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1739 microversion: 2.20 time: 0.723961 Aug 17 23:47:58.502404 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 334/675] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:57 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1739 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:47:59.516262 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-8cfa23ce-c859-4c10-9d19-98386f48f800 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:47:59.516971 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-8cfa23ce-c859-4c10-9d19-98386f48f800 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:59.518920 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-445d9934-3d41-496c-82cf-e5bae12bb9c0 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1826374631"}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:47:59.519614 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-445d9934-3d41-496c-82cf-e5bae12bb9c0 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:47:59.526673 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-445d9934-3d41-496c-82cf-e5bae12bb9c0 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:59.527165 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-445d9934-3d41-496c-82cf-e5bae12bb9c0 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:59.527604 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-445d9934-3d41-496c-82cf-e5bae12bb9c0 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:59.528380 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-445d9934-3d41-496c-82cf-e5bae12bb9c0 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:59.528842 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-445d9934-3d41-496c-82cf-e5bae12bb9c0 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:59.529460 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-445d9934-3d41-496c-82cf-e5bae12bb9c0 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:59.531908 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8cfa23ce-c859-4c10-9d19-98386f48f800 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:59.532607 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8cfa23ce-c859-4c10-9d19-98386f48f800 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:59.533972 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8cfa23ce-c859-4c10-9d19-98386f48f800 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:59.534885 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8cfa23ce-c859-4c10-9d19-98386f48f800 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:47:59.535541 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8cfa23ce-c859-4c10-9d19-98386f48f800 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:47:59.536575 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8cfa23ce-c859-4c10-9d19-98386f48f800 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:47:59.699081 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8cfa23ce-c859-4c10-9d19-98386f48f800 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:59.707287 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8cfa23ce-c859-4c10-9d19-98386f48f800 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:59.708834 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8cfa23ce-c859-4c10-9d19-98386f48f800 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:47:59.709990 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-8cfa23ce-c859-4c10-9d19-98386f48f800 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1739 microversion: 2.20 time: 0.197970 Aug 17 23:47:59.711076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 335/676] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:47:59 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:47:59.713160 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.network.security_group_api [None req-445d9934-3d41-496c-82cf-e5bae12bb9c0 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Adding security group 380495f3-2c92-480a-8081-bbaf83713f81 to port e95c1c30-368b-4623-86e2-0d608e9a186a Aug 17 23:48:00.092469 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-445d9934-3d41-496c-82cf-e5bae12bb9c0 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "POST /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017/action" status: 202 len: 0 microversion: 2.1 time: 0.580138 Aug 17 23:48:00.093428 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 342/677] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 17 23:47:59 2022] POST /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:48:00.101673 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-23775075-fbc4-40f3-b688-88b4426bf562 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:00.102370 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-23775075-fbc4-40f3-b688-88b4426bf562 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:00.104846 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-4efc2c7b-1e74-48fd-9295-87b6d8bfe760 req-8fc52a93-48d9-463d-9d06-e245d616c3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930c290f-5bb3-44fe-857d-9d5423eca017", "tag": "e95c1c30-368b-4623-86e2-0d608e9a186a"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:48:00.114496 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23775075-fbc4-40f3-b688-88b4426bf562 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:00.116642 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-4efc2c7b-1e74-48fd-9295-87b6d8bfe760 req-8fc52a93-48d9-463d-9d06-e245d616c3f6 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:00.117152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-4efc2c7b-1e74-48fd-9295-87b6d8bfe760 req-8fc52a93-48d9-463d-9d06-e245d616c3f6 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:00.117845 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-4efc2c7b-1e74-48fd-9295-87b6d8bfe760 req-8fc52a93-48d9-463d-9d06-e245d616c3f6 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:00.118832 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23775075-fbc4-40f3-b688-88b4426bf562 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:00.119415 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23775075-fbc4-40f3-b688-88b4426bf562 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:00.120972 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23775075-fbc4-40f3-b688-88b4426bf562 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:00.120972 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23775075-fbc4-40f3-b688-88b4426bf562 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:00.121458 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23775075-fbc4-40f3-b688-88b4426bf562 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:00.135024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-4efc2c7b-1e74-48fd-9295-87b6d8bfe760 req-8fc52a93-48d9-463d-9d06-e245d616c3f6 service nova] Creating event network-changed:e95c1c30-368b-4623-86e2-0d608e9a186a for instance 930c290f-5bb3-44fe-857d-9d5423eca017 on hv-cinder-82002 Aug 17 23:48:00.142108 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-4efc2c7b-1e74-48fd-9295-87b6d8bfe760 req-8fc52a93-48d9-463d-9d06-e245d616c3f6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041188 Aug 17 23:48:00.143685 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 343/678] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:48:00.333207 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-23775075-fbc4-40f3-b688-88b4426bf562 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:00.345853 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-23775075-fbc4-40f3-b688-88b4426bf562 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1760 microversion: 2.1 time: 0.248351 Aug 17 23:48:00.346843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 336/679] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:00 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1760 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:00.740266 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-0a80eafe-160d-45b1-9ef1-53389313fe7f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:00.742016 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-0a80eafe-160d-45b1-9ef1-53389313fe7f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:00.756353 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0a80eafe-160d-45b1-9ef1-53389313fe7f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:00.756951 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0a80eafe-160d-45b1-9ef1-53389313fe7f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:00.757958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0a80eafe-160d-45b1-9ef1-53389313fe7f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:00.759237 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0a80eafe-160d-45b1-9ef1-53389313fe7f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:00.759705 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0a80eafe-160d-45b1-9ef1-53389313fe7f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:00.774577 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0a80eafe-160d-45b1-9ef1-53389313fe7f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:01.019285 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0a80eafe-160d-45b1-9ef1-53389313fe7f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:01.029074 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0a80eafe-160d-45b1-9ef1-53389313fe7f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:01.032025 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0a80eafe-160d-45b1-9ef1-53389313fe7f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:01.033571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-0a80eafe-160d-45b1-9ef1-53389313fe7f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1739 microversion: 2.20 time: 0.301430 Aug 17 23:48:01.034395 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 344/680] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:00 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1739 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:01.532789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-d343ae7c-c61f-4757-93f8-f2fb52acbe22 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:01.533331 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-d343ae7c-c61f-4757-93f8-f2fb52acbe22 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:01.540652 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d343ae7c-c61f-4757-93f8-f2fb52acbe22 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:01.541194 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d343ae7c-c61f-4757-93f8-f2fb52acbe22 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:01.541814 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d343ae7c-c61f-4757-93f8-f2fb52acbe22 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:01.542516 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d343ae7c-c61f-4757-93f8-f2fb52acbe22 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:01.542975 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d343ae7c-c61f-4757-93f8-f2fb52acbe22 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:01.543407 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d343ae7c-c61f-4757-93f8-f2fb52acbe22 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:01.567772 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-d343ae7c-c61f-4757-93f8-f2fb52acbe22 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227/ips" status: 200 len: 146 microversion: 2.1 time: 0.040500 Aug 17 23:48:01.568820 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 337/681] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Aug 17 23:48:01 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:48:02.060364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ac6e26a4-6a62-42b2-9400-47a42ed01ff1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:02.061613 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ac6e26a4-6a62-42b2-9400-47a42ed01ff1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:02.071157 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac6e26a4-6a62-42b2-9400-47a42ed01ff1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:02.072201 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac6e26a4-6a62-42b2-9400-47a42ed01ff1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:02.073442 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac6e26a4-6a62-42b2-9400-47a42ed01ff1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:02.074604 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac6e26a4-6a62-42b2-9400-47a42ed01ff1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:02.075341 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac6e26a4-6a62-42b2-9400-47a42ed01ff1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:02.075823 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac6e26a4-6a62-42b2-9400-47a42ed01ff1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:02.226025 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ac6e26a4-6a62-42b2-9400-47a42ed01ff1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:02.234196 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ac6e26a4-6a62-42b2-9400-47a42ed01ff1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:02.235688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ac6e26a4-6a62-42b2-9400-47a42ed01ff1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:02.238967 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ac6e26a4-6a62-42b2-9400-47a42ed01ff1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1739 microversion: 2.20 time: 0.183172 Aug 17 23:48:02.239532 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 345/682] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:02 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:03.262789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-248c3cd8-fb1e-45a1-b64b-5acb7c6bc196 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:03.263414 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-248c3cd8-fb1e-45a1-b64b-5acb7c6bc196 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:03.274077 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-248c3cd8-fb1e-45a1-b64b-5acb7c6bc196 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:03.274787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-248c3cd8-fb1e-45a1-b64b-5acb7c6bc196 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:03.275399 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-248c3cd8-fb1e-45a1-b64b-5acb7c6bc196 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:03.276285 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-248c3cd8-fb1e-45a1-b64b-5acb7c6bc196 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:03.277101 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-248c3cd8-fb1e-45a1-b64b-5acb7c6bc196 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:03.277695 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-248c3cd8-fb1e-45a1-b64b-5acb7c6bc196 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:03.412637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-248c3cd8-fb1e-45a1-b64b-5acb7c6bc196 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:03.423508 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-248c3cd8-fb1e-45a1-b64b-5acb7c6bc196 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:03.425478 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-248c3cd8-fb1e-45a1-b64b-5acb7c6bc196 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:03.426704 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-248c3cd8-fb1e-45a1-b64b-5acb7c6bc196 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1739 microversion: 2.20 time: 0.168033 Aug 17 23:48:03.427315 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 338/683] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:03 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:04.449890 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-22a89b10-1ba3-4f80-a70f-b622a5aacbec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:04.450518 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-22a89b10-1ba3-4f80-a70f-b622a5aacbec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:04.457127 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-22a89b10-1ba3-4f80-a70f-b622a5aacbec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:04.457621 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-22a89b10-1ba3-4f80-a70f-b622a5aacbec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:04.458055 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-22a89b10-1ba3-4f80-a70f-b622a5aacbec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:04.458746 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-22a89b10-1ba3-4f80-a70f-b622a5aacbec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:04.459200 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-22a89b10-1ba3-4f80-a70f-b622a5aacbec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:04.459624 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-22a89b10-1ba3-4f80-a70f-b622a5aacbec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:04.599010 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-22a89b10-1ba3-4f80-a70f-b622a5aacbec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:04.607104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-22a89b10-1ba3-4f80-a70f-b622a5aacbec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:04.608892 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-22a89b10-1ba3-4f80-a70f-b622a5aacbec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:04.610047 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-22a89b10-1ba3-4f80-a70f-b622a5aacbec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1739 microversion: 2.20 time: 0.164113 Aug 17 23:48:04.610606 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 346/684] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:04 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:48:05.632319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ba735192-d16d-4cd0-898d-d846bfa75b00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:05.632853 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ba735192-d16d-4cd0-898d-d846bfa75b00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:05.639194 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ba735192-d16d-4cd0-898d-d846bfa75b00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:05.639712 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ba735192-d16d-4cd0-898d-d846bfa75b00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:05.640185 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ba735192-d16d-4cd0-898d-d846bfa75b00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:05.640872 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ba735192-d16d-4cd0-898d-d846bfa75b00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:05.641330 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ba735192-d16d-4cd0-898d-d846bfa75b00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:05.641754 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ba735192-d16d-4cd0-898d-d846bfa75b00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:05.773166 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ba735192-d16d-4cd0-898d-d846bfa75b00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:05.780964 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ba735192-d16d-4cd0-898d-d846bfa75b00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:05.782455 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ba735192-d16d-4cd0-898d-d846bfa75b00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:05.783601 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ba735192-d16d-4cd0-898d-d846bfa75b00 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1721 microversion: 2.20 time: 0.155286 Aug 17 23:48:05.784189 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 339/685] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:05 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:06.504214 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ebe81b09-586d-4c2c-825d-431cc730af5f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bb9a702-c4f2-43d9-8dc3-a35992db7689"}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:48:06.506513 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ebe81b09-586d-4c2c-825d-431cc730af5f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:06.509689 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=66 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:48:06.515131 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ebe81b09-586d-4c2c-825d-431cc730af5f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:06.515631 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ebe81b09-586d-4c2c-825d-431cc730af5f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:06.516108 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ebe81b09-586d-4c2c-825d-431cc730af5f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:06.516801 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ebe81b09-586d-4c2c-825d-431cc730af5f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:06.517282 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ebe81b09-586d-4c2c-825d-431cc730af5f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:06.517709 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ebe81b09-586d-4c2c-825d-431cc730af5f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:06.807672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-779d0a10-adb1-4ea9-baa1-5efe22b9c31c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:06.808323 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-779d0a10-adb1-4ea9-baa1-5efe22b9c31c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:06.814673 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-779d0a10-adb1-4ea9-baa1-5efe22b9c31c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:06.815156 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-779d0a10-adb1-4ea9-baa1-5efe22b9c31c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:06.815593 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-779d0a10-adb1-4ea9-baa1-5efe22b9c31c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:06.816311 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-779d0a10-adb1-4ea9-baa1-5efe22b9c31c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:06.816767 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-779d0a10-adb1-4ea9-baa1-5efe22b9c31c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:06.817189 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-779d0a10-adb1-4ea9-baa1-5efe22b9c31c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:06.944715 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-779d0a10-adb1-4ea9-baa1-5efe22b9c31c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:06.952513 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-779d0a10-adb1-4ea9-baa1-5efe22b9c31c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:06.954004 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-779d0a10-adb1-4ea9-baa1-5efe22b9c31c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:06.955537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-779d0a10-adb1-4ea9-baa1-5efe22b9c31c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1721 microversion: 2.20 time: 0.151965 Aug 17 23:48:06.956121 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 340/686] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:06 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:48:07.647198 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-3a772a9a-75d3-4f8a-abea-0c1034eda937 req-d2e9c13e-4ffb-42c7-ab3b-c4dc99211fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abc34597-7782-4715-86c3-6a940ecde323", "name": "network-vif-unplugged", "status": "completed", "tag": "bce8dab3-ded2-46e7-a72a-7a52eb3c9201"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:48:07.658575 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-3a772a9a-75d3-4f8a-abea-0c1034eda937 req-d2e9c13e-4ffb-42c7-ab3b-c4dc99211fbf service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:07.659092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-3a772a9a-75d3-4f8a-abea-0c1034eda937 req-d2e9c13e-4ffb-42c7-ab3b-c4dc99211fbf service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:07.659694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-3a772a9a-75d3-4f8a-abea-0c1034eda937 req-d2e9c13e-4ffb-42c7-ab3b-c4dc99211fbf service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:07.672156 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-3a772a9a-75d3-4f8a-abea-0c1034eda937 req-d2e9c13e-4ffb-42c7-ab3b-c4dc99211fbf service nova] Creating event network-vif-unplugged:bce8dab3-ded2-46e7-a72a-7a52eb3c9201 for instance abc34597-7782-4715-86c3-6a940ecde323 on hv-cinder-82002 Aug 17 23:48:07.677403 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-3a772a9a-75d3-4f8a-abea-0c1034eda937 req-d2e9c13e-4ffb-42c7-ab3b-c4dc99211fbf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033969 Aug 17 23:48:07.677992 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 341/687] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:48:07.740810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ebe81b09-586d-4c2c-825d-431cc730af5f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "POST /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.240428 Aug 17 23:48:07.741600 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 347/688] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 17 23:48:06 2022] POST /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227/os-volume_attachments => generated 194 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:48:07.978710 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e72e1646-2027-49fd-bd35-0ad3b3abdfa7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:07.979405 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e72e1646-2027-49fd-bd35-0ad3b3abdfa7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:07.985836 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e72e1646-2027-49fd-bd35-0ad3b3abdfa7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:07.986315 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e72e1646-2027-49fd-bd35-0ad3b3abdfa7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:07.986748 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e72e1646-2027-49fd-bd35-0ad3b3abdfa7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:07.987432 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e72e1646-2027-49fd-bd35-0ad3b3abdfa7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:07.987885 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e72e1646-2027-49fd-bd35-0ad3b3abdfa7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:07.988342 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e72e1646-2027-49fd-bd35-0ad3b3abdfa7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:08.132849 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e72e1646-2027-49fd-bd35-0ad3b3abdfa7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:08.141496 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e72e1646-2027-49fd-bd35-0ad3b3abdfa7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:08.143031 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e72e1646-2027-49fd-bd35-0ad3b3abdfa7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:08.144249 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e72e1646-2027-49fd-bd35-0ad3b3abdfa7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1724 microversion: 2.20 time: 0.170221 Aug 17 23:48:08.144851 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 342/689] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:07 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:08.167617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c0f9e072-df9d-4aa9-aa8a-ea4fb49689df tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ab2a79b-a2a7-44bd-aa0e-8ea4ab0e4e25"}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:48:08.170119 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c0f9e072-df9d-4aa9-aa8a-ea4fb49689df tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:08.176456 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0f9e072-df9d-4aa9-aa8a-ea4fb49689df tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:08.176937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0f9e072-df9d-4aa9-aa8a-ea4fb49689df tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:08.177368 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0f9e072-df9d-4aa9-aa8a-ea4fb49689df tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:08.178047 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0f9e072-df9d-4aa9-aa8a-ea4fb49689df tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:08.178498 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0f9e072-df9d-4aa9-aa8a-ea4fb49689df tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:08.179423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0f9e072-df9d-4aa9-aa8a-ea4fb49689df tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:08.447593 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:48:08.454646 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c0f9e072-df9d-4aa9-aa8a-ea4fb49689df tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "POST /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.291972 Aug 17 23:48:08.459171 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 348/690] 10.222.0.26 () {62 vars in 1364 bytes} [Wed Aug 17 23:48:08 2022] POST /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323/os-volume_attachments => generated 188 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 23:48:08.583469 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5d1c6b4f-80dc-4993-9185-e95c38e5d23d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:48:08.584418 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5d1c6b4f-80dc-4993-9185-e95c38e5d23d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:08.590670 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d1c6b4f-80dc-4993-9185-e95c38e5d23d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:08.591153 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d1c6b4f-80dc-4993-9185-e95c38e5d23d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:08.591615 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d1c6b4f-80dc-4993-9185-e95c38e5d23d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:08.592399 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d1c6b4f-80dc-4993-9185-e95c38e5d23d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:08.593613 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d1c6b4f-80dc-4993-9185-e95c38e5d23d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:08.594050 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d1c6b4f-80dc-4993-9185-e95c38e5d23d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:08.639028 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5d1c6b4f-80dc-4993-9185-e95c38e5d23d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=131395) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 23:48:08.705489 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5d1c6b4f-80dc-4993-9185-e95c38e5d23d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "POST /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323/action" status: 202 len: 0 microversion: 2.20 time: 0.127751 Aug 17 23:48:08.706079 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 343/691] 10.222.0.26 () {62 vars in 1319 bytes} [Wed Aug 17 23:48:08 2022] POST /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 17 23:48:08.715044 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-46b23dcb-91d0-4ede-89ee-927125619f8b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:08.715748 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-46b23dcb-91d0-4ede-89ee-927125619f8b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:08.722706 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-46b23dcb-91d0-4ede-89ee-927125619f8b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:08.723195 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-46b23dcb-91d0-4ede-89ee-927125619f8b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:08.723632 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-46b23dcb-91d0-4ede-89ee-927125619f8b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:08.724488 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-46b23dcb-91d0-4ede-89ee-927125619f8b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:08.724944 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-46b23dcb-91d0-4ede-89ee-927125619f8b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:08.725368 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-46b23dcb-91d0-4ede-89ee-927125619f8b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:08.875404 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-46b23dcb-91d0-4ede-89ee-927125619f8b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:08.884012 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-46b23dcb-91d0-4ede-89ee-927125619f8b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:08.885836 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-46b23dcb-91d0-4ede-89ee-927125619f8b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:08.887040 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-46b23dcb-91d0-4ede-89ee-927125619f8b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1750 microversion: 2.20 time: 0.176797 Aug 17 23:48:08.887588 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 349/692] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:08 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:09.911653 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f45517d6-f56a-4084-aa7e-c2baa423749a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:09.912407 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f45517d6-f56a-4084-aa7e-c2baa423749a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:09.918973 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f45517d6-f56a-4084-aa7e-c2baa423749a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:09.919554 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f45517d6-f56a-4084-aa7e-c2baa423749a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:09.920193 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f45517d6-f56a-4084-aa7e-c2baa423749a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:09.920950 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f45517d6-f56a-4084-aa7e-c2baa423749a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:09.921487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f45517d6-f56a-4084-aa7e-c2baa423749a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:09.921968 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f45517d6-f56a-4084-aa7e-c2baa423749a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:10.059734 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f45517d6-f56a-4084-aa7e-c2baa423749a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:10.068223 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f45517d6-f56a-4084-aa7e-c2baa423749a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:10.069759 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f45517d6-f56a-4084-aa7e-c2baa423749a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:10.071002 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f45517d6-f56a-4084-aa7e-c2baa423749a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1752 microversion: 2.20 time: 0.164783 Aug 17 23:48:10.071562 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 344/693] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:09 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:11.094061 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-579286d9-deed-40eb-8fc8-cfbca1b77467 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:11.094592 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-579286d9-deed-40eb-8fc8-cfbca1b77467 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:11.101002 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-579286d9-deed-40eb-8fc8-cfbca1b77467 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:11.101495 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-579286d9-deed-40eb-8fc8-cfbca1b77467 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:11.101927 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-579286d9-deed-40eb-8fc8-cfbca1b77467 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:11.102630 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-579286d9-deed-40eb-8fc8-cfbca1b77467 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:11.103079 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-579286d9-deed-40eb-8fc8-cfbca1b77467 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:11.103533 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-579286d9-deed-40eb-8fc8-cfbca1b77467 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:11.232446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-579286d9-deed-40eb-8fc8-cfbca1b77467 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:11.240560 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-579286d9-deed-40eb-8fc8-cfbca1b77467 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:11.242547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-579286d9-deed-40eb-8fc8-cfbca1b77467 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:11.243679 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-579286d9-deed-40eb-8fc8-cfbca1b77467 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1752 microversion: 2.20 time: 0.153622 Aug 17 23:48:11.244264 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 350/694] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:11 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:12.266782 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-93127b1b-5aa3-4b57-8064-27e0c16af8ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:12.267388 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-93127b1b-5aa3-4b57-8064-27e0c16af8ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:12.274496 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-93127b1b-5aa3-4b57-8064-27e0c16af8ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:12.274928 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-93127b1b-5aa3-4b57-8064-27e0c16af8ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:12.275364 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-93127b1b-5aa3-4b57-8064-27e0c16af8ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:12.276079 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-93127b1b-5aa3-4b57-8064-27e0c16af8ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:12.276537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-93127b1b-5aa3-4b57-8064-27e0c16af8ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:12.276962 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-93127b1b-5aa3-4b57-8064-27e0c16af8ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:12.457285 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-93127b1b-5aa3-4b57-8064-27e0c16af8ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:12.460893 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:48:12.466551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-93127b1b-5aa3-4b57-8064-27e0c16af8ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:12.468060 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-93127b1b-5aa3-4b57-8064-27e0c16af8ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:12.469212 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-93127b1b-5aa3-4b57-8064-27e0c16af8ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1752 microversion: 2.20 time: 0.206308 Aug 17 23:48:12.469764 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 345/695] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:12 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1752 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:13.491925 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-63960c17-2af6-49dd-99bd-5b62fc234718 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:13.492545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-63960c17-2af6-49dd-99bd-5b62fc234718 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:13.498886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-63960c17-2af6-49dd-99bd-5b62fc234718 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:13.499368 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-63960c17-2af6-49dd-99bd-5b62fc234718 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:13.499805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-63960c17-2af6-49dd-99bd-5b62fc234718 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:13.500637 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-63960c17-2af6-49dd-99bd-5b62fc234718 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:13.501089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-63960c17-2af6-49dd-99bd-5b62fc234718 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:13.501511 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-63960c17-2af6-49dd-99bd-5b62fc234718 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:13.683735 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-63960c17-2af6-49dd-99bd-5b62fc234718 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:13.692140 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-63960c17-2af6-49dd-99bd-5b62fc234718 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:13.693632 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-63960c17-2af6-49dd-99bd-5b62fc234718 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:13.694785 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-63960c17-2af6-49dd-99bd-5b62fc234718 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1752 microversion: 2.20 time: 0.206740 Aug 17 23:48:13.695855 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 351/696] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:13 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1752 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:14.718423 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-23f6c49e-2bc7-4f3c-b67f-d3da04ee85dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:14.719072 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-23f6c49e-2bc7-4f3c-b67f-d3da04ee85dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:14.726057 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23f6c49e-2bc7-4f3c-b67f-d3da04ee85dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:14.727223 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23f6c49e-2bc7-4f3c-b67f-d3da04ee85dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:14.727680 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23f6c49e-2bc7-4f3c-b67f-d3da04ee85dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:14.728373 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23f6c49e-2bc7-4f3c-b67f-d3da04ee85dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:14.728823 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23f6c49e-2bc7-4f3c-b67f-d3da04ee85dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:14.729240 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23f6c49e-2bc7-4f3c-b67f-d3da04ee85dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:14.874174 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-23f6c49e-2bc7-4f3c-b67f-d3da04ee85dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:14.882532 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-23f6c49e-2bc7-4f3c-b67f-d3da04ee85dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:14.884190 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-23f6c49e-2bc7-4f3c-b67f-d3da04ee85dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:14.885333 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-23f6c49e-2bc7-4f3c-b67f-d3da04ee85dd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1752 microversion: 2.20 time: 0.171458 Aug 17 23:48:14.885920 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 346/697] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:14 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:15.908514 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d9e8416f-a8ac-468d-9150-717f20b3c88b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:15.909044 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d9e8416f-a8ac-468d-9150-717f20b3c88b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:15.916128 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d9e8416f-a8ac-468d-9150-717f20b3c88b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:15.916601 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d9e8416f-a8ac-468d-9150-717f20b3c88b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:15.917032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d9e8416f-a8ac-468d-9150-717f20b3c88b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:15.917706 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d9e8416f-a8ac-468d-9150-717f20b3c88b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:15.918156 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d9e8416f-a8ac-468d-9150-717f20b3c88b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:15.918577 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d9e8416f-a8ac-468d-9150-717f20b3c88b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:16.049393 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d9e8416f-a8ac-468d-9150-717f20b3c88b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:16.058356 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d9e8416f-a8ac-468d-9150-717f20b3c88b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:16.059823 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d9e8416f-a8ac-468d-9150-717f20b3c88b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:16.060991 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d9e8416f-a8ac-468d-9150-717f20b3c88b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1752 microversion: 2.20 time: 0.156339 Aug 17 23:48:16.061537 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 352/698] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:15 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:16.320450 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-894e7398-f564-45e6-83bc-32840d9e290a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:48:16.323018 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:48:16.328675 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-894e7398-f564-45e6-83bc-32840d9e290a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:16.329234 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-894e7398-f564-45e6-83bc-32840d9e290a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:16.329713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-894e7398-f564-45e6-83bc-32840d9e290a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:16.390638 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-894e7398-f564-45e6-83bc-32840d9e290a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Going to try to stop instance {{(pid=131395) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 17 23:48:16.435551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-894e7398-f564-45e6-83bc-32840d9e290a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "POST /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227/action" status: 202 len: 0 microversion: 2.1 time: 0.118884 Aug 17 23:48:16.436212 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 347/699] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 17 23:48:16 2022] POST /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:48:16.444213 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8c54db36-9cc0-43f2-9c08-d28c795e9ec6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:16.444845 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8c54db36-9cc0-43f2-9c08-d28c795e9ec6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:16.450854 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8c54db36-9cc0-43f2-9c08-d28c795e9ec6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:16.451343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8c54db36-9cc0-43f2-9c08-d28c795e9ec6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:16.451839 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8c54db36-9cc0-43f2-9c08-d28c795e9ec6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:16.452505 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8c54db36-9cc0-43f2-9c08-d28c795e9ec6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:16.452966 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8c54db36-9cc0-43f2-9c08-d28c795e9ec6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:16.453429 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8c54db36-9cc0-43f2-9c08-d28c795e9ec6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:16.581355 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-8c54db36-9cc0-43f2-9c08-d28c795e9ec6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:16.589943 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8c54db36-9cc0-43f2-9c08-d28c795e9ec6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1722 microversion: 2.1 time: 0.149637 Aug 17 23:48:16.590503 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 353/700] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:16 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:17.084256 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-d1e367e9-27aa-4199-b998-01177401c524 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:17.084866 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-d1e367e9-27aa-4199-b998-01177401c524 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:17.090991 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d1e367e9-27aa-4199-b998-01177401c524 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:17.091474 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d1e367e9-27aa-4199-b998-01177401c524 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:17.091907 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d1e367e9-27aa-4199-b998-01177401c524 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:17.092616 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d1e367e9-27aa-4199-b998-01177401c524 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:17.093067 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d1e367e9-27aa-4199-b998-01177401c524 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:17.093490 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d1e367e9-27aa-4199-b998-01177401c524 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:17.223099 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d1e367e9-27aa-4199-b998-01177401c524 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:17.232036 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d1e367e9-27aa-4199-b998-01177401c524 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:17.233546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d1e367e9-27aa-4199-b998-01177401c524 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:17.234696 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-d1e367e9-27aa-4199-b998-01177401c524 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.154829 Aug 17 23:48:17.235252 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 348/701] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:17 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:17.611105 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e16345d5-3f21-4eed-a67f-bbf745fc9948 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:17.611704 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e16345d5-3f21-4eed-a67f-bbf745fc9948 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:17.618779 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e16345d5-3f21-4eed-a67f-bbf745fc9948 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:17.619271 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e16345d5-3f21-4eed-a67f-bbf745fc9948 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:17.619707 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e16345d5-3f21-4eed-a67f-bbf745fc9948 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:17.620437 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e16345d5-3f21-4eed-a67f-bbf745fc9948 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:17.620894 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e16345d5-3f21-4eed-a67f-bbf745fc9948 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:17.621323 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e16345d5-3f21-4eed-a67f-bbf745fc9948 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:17.806617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e16345d5-3f21-4eed-a67f-bbf745fc9948 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:17.814463 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e16345d5-3f21-4eed-a67f-bbf745fc9948 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1722 microversion: 2.1 time: 0.207374 Aug 17 23:48:17.815026 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 354/702] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:17 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:18.258455 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3def5a2a-c1a6-4bd2-a72d-634d56c07d16 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:18.259065 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3def5a2a-c1a6-4bd2-a72d-634d56c07d16 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:18.265484 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3def5a2a-c1a6-4bd2-a72d-634d56c07d16 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:18.265969 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3def5a2a-c1a6-4bd2-a72d-634d56c07d16 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:18.266411 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3def5a2a-c1a6-4bd2-a72d-634d56c07d16 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:18.267100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3def5a2a-c1a6-4bd2-a72d-634d56c07d16 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:18.267562 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3def5a2a-c1a6-4bd2-a72d-634d56c07d16 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:18.268007 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3def5a2a-c1a6-4bd2-a72d-634d56c07d16 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:18.397100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3def5a2a-c1a6-4bd2-a72d-634d56c07d16 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:18.405472 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3def5a2a-c1a6-4bd2-a72d-634d56c07d16 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:18.406956 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3def5a2a-c1a6-4bd2-a72d-634d56c07d16 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:18.408128 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3def5a2a-c1a6-4bd2-a72d-634d56c07d16 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.154082 Aug 17 23:48:18.408672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 349/703] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:18 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:18.835843 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-64c4fef0-2e72-4169-847a-c619b45daa31 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:18.836540 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-64c4fef0-2e72-4169-847a-c619b45daa31 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:18.843497 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-64c4fef0-2e72-4169-847a-c619b45daa31 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:18.844531 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-64c4fef0-2e72-4169-847a-c619b45daa31 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:18.845356 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-64c4fef0-2e72-4169-847a-c619b45daa31 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:18.846382 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-64c4fef0-2e72-4169-847a-c619b45daa31 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:18.847259 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-64c4fef0-2e72-4169-847a-c619b45daa31 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:18.848000 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-64c4fef0-2e72-4169-847a-c619b45daa31 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:19.002283 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-64c4fef0-2e72-4169-847a-c619b45daa31 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:19.011227 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-64c4fef0-2e72-4169-847a-c619b45daa31 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1722 microversion: 2.1 time: 0.180079 Aug 17 23:48:19.011811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 355/704] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:18 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:19.431423 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a654e83b-a035-46f6-9fd2-82eba638399b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:19.432084 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a654e83b-a035-46f6-9fd2-82eba638399b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:19.438000 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a654e83b-a035-46f6-9fd2-82eba638399b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:19.438479 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a654e83b-a035-46f6-9fd2-82eba638399b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:19.438939 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a654e83b-a035-46f6-9fd2-82eba638399b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:19.439627 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a654e83b-a035-46f6-9fd2-82eba638399b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:19.440104 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a654e83b-a035-46f6-9fd2-82eba638399b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:19.440526 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a654e83b-a035-46f6-9fd2-82eba638399b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:19.575694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a654e83b-a035-46f6-9fd2-82eba638399b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:19.603542 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a654e83b-a035-46f6-9fd2-82eba638399b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:19.605092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a654e83b-a035-46f6-9fd2-82eba638399b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:19.606255 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a654e83b-a035-46f6-9fd2-82eba638399b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.178981 Aug 17 23:48:19.606815 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 350/705] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:19 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:20.032552 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-99a0364a-0e09-4394-b947-37b40fb1417d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:20.033166 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-99a0364a-0e09-4394-b947-37b40fb1417d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:20.039780 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-99a0364a-0e09-4394-b947-37b40fb1417d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:20.040308 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-99a0364a-0e09-4394-b947-37b40fb1417d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:20.040743 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-99a0364a-0e09-4394-b947-37b40fb1417d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:20.041426 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-99a0364a-0e09-4394-b947-37b40fb1417d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:20.041886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-99a0364a-0e09-4394-b947-37b40fb1417d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:20.042307 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-99a0364a-0e09-4394-b947-37b40fb1417d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:20.175444 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-99a0364a-0e09-4394-b947-37b40fb1417d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:20.183915 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-99a0364a-0e09-4394-b947-37b40fb1417d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1722 microversion: 2.1 time: 0.155298 Aug 17 23:48:20.184506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 356/706] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:20 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:20.628913 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-7574267d-551a-46e6-b586-28954e68c092 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:20.629684 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-7574267d-551a-46e6-b586-28954e68c092 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:20.636217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7574267d-551a-46e6-b586-28954e68c092 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:20.636693 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7574267d-551a-46e6-b586-28954e68c092 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:20.637123 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7574267d-551a-46e6-b586-28954e68c092 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:20.637806 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7574267d-551a-46e6-b586-28954e68c092 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:20.638395 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7574267d-551a-46e6-b586-28954e68c092 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:20.638880 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7574267d-551a-46e6-b586-28954e68c092 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:20.781035 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7574267d-551a-46e6-b586-28954e68c092 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:20.790818 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7574267d-551a-46e6-b586-28954e68c092 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:20.792388 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7574267d-551a-46e6-b586-28954e68c092 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:20.793543 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-7574267d-551a-46e6-b586-28954e68c092 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.168681 Aug 17 23:48:20.794097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 351/707] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:20 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:21.205644 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-85eb6dbb-1496-411a-a507-b62abdd955c1 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:21.206295 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-85eb6dbb-1496-411a-a507-b62abdd955c1 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:21.213152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85eb6dbb-1496-411a-a507-b62abdd955c1 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:21.213633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85eb6dbb-1496-411a-a507-b62abdd955c1 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:21.214071 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85eb6dbb-1496-411a-a507-b62abdd955c1 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:21.214758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85eb6dbb-1496-411a-a507-b62abdd955c1 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:21.215213 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85eb6dbb-1496-411a-a507-b62abdd955c1 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:21.215635 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-85eb6dbb-1496-411a-a507-b62abdd955c1 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:21.345462 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-85eb6dbb-1496-411a-a507-b62abdd955c1 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:21.353936 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-85eb6dbb-1496-411a-a507-b62abdd955c1 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1722 microversion: 2.1 time: 0.152134 Aug 17 23:48:21.354523 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 357/708] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:21 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:21.817213 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ba583849-fcc3-49aa-a240-a56a2170d494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:21.818934 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ba583849-fcc3-49aa-a240-a56a2170d494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:21.826851 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ba583849-fcc3-49aa-a240-a56a2170d494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:21.827348 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ba583849-fcc3-49aa-a240-a56a2170d494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:21.827810 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ba583849-fcc3-49aa-a240-a56a2170d494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:21.828699 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ba583849-fcc3-49aa-a240-a56a2170d494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:21.829168 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ba583849-fcc3-49aa-a240-a56a2170d494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:21.829578 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ba583849-fcc3-49aa-a240-a56a2170d494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:21.960983 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ba583849-fcc3-49aa-a240-a56a2170d494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:21.972356 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ba583849-fcc3-49aa-a240-a56a2170d494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:21.974230 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ba583849-fcc3-49aa-a240-a56a2170d494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:21.975664 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ba583849-fcc3-49aa-a240-a56a2170d494 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.162888 Aug 17 23:48:21.976810 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 352/709] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:21 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:22.378819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d34d29b5-8bd9-49a8-89a9-f7195eb14b1a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:22.380286 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d34d29b5-8bd9-49a8-89a9-f7195eb14b1a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:22.387112 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d34d29b5-8bd9-49a8-89a9-f7195eb14b1a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:22.387599 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d34d29b5-8bd9-49a8-89a9-f7195eb14b1a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:22.388062 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d34d29b5-8bd9-49a8-89a9-f7195eb14b1a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:22.388777 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d34d29b5-8bd9-49a8-89a9-f7195eb14b1a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:22.389229 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d34d29b5-8bd9-49a8-89a9-f7195eb14b1a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:22.389683 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d34d29b5-8bd9-49a8-89a9-f7195eb14b1a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:22.529794 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d34d29b5-8bd9-49a8-89a9-f7195eb14b1a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:22.538832 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d34d29b5-8bd9-49a8-89a9-f7195eb14b1a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1722 microversion: 2.1 time: 0.165528 Aug 17 23:48:22.540039 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 358/710] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:22 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:22.998709 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-8b7c29a9-a9dd-46b1-9f2f-c562d9e0a03a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:22.999332 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-8b7c29a9-a9dd-46b1-9f2f-c562d9e0a03a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:23.005765 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8b7c29a9-a9dd-46b1-9f2f-c562d9e0a03a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:23.006247 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8b7c29a9-a9dd-46b1-9f2f-c562d9e0a03a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:23.006684 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8b7c29a9-a9dd-46b1-9f2f-c562d9e0a03a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:23.007998 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8b7c29a9-a9dd-46b1-9f2f-c562d9e0a03a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:23.008495 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8b7c29a9-a9dd-46b1-9f2f-c562d9e0a03a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:23.008922 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8b7c29a9-a9dd-46b1-9f2f-c562d9e0a03a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:23.156627 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8b7c29a9-a9dd-46b1-9f2f-c562d9e0a03a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:23.165445 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8b7c29a9-a9dd-46b1-9f2f-c562d9e0a03a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:23.166985 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8b7c29a9-a9dd-46b1-9f2f-c562d9e0a03a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:23.168176 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-8b7c29a9-a9dd-46b1-9f2f-c562d9e0a03a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.173350 Aug 17 23:48:23.168738 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 353/711] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:22 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:23.560753 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-5d4520a2-d5d4-451f-93c0-dbbb47bd0e7c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:23.561353 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-5d4520a2-d5d4-451f-93c0-dbbb47bd0e7c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:23.568231 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5d4520a2-d5d4-451f-93c0-dbbb47bd0e7c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:23.568816 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5d4520a2-d5d4-451f-93c0-dbbb47bd0e7c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:23.569320 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5d4520a2-d5d4-451f-93c0-dbbb47bd0e7c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:23.570887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5d4520a2-d5d4-451f-93c0-dbbb47bd0e7c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:23.571419 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5d4520a2-d5d4-451f-93c0-dbbb47bd0e7c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:23.572720 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5d4520a2-d5d4-451f-93c0-dbbb47bd0e7c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:23.702752 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5d4520a2-d5d4-451f-93c0-dbbb47bd0e7c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:23.710591 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-5d4520a2-d5d4-451f-93c0-dbbb47bd0e7c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1722 microversion: 2.1 time: 0.154098 Aug 17 23:48:23.711166 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 359/712] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:23 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:24.191940 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3f5184fc-9b43-4a52-b403-a84f83b06b80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:24.192644 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3f5184fc-9b43-4a52-b403-a84f83b06b80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:24.199372 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3f5184fc-9b43-4a52-b403-a84f83b06b80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:24.199853 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3f5184fc-9b43-4a52-b403-a84f83b06b80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:24.200318 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3f5184fc-9b43-4a52-b403-a84f83b06b80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:24.201009 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3f5184fc-9b43-4a52-b403-a84f83b06b80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:24.201471 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3f5184fc-9b43-4a52-b403-a84f83b06b80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:24.201893 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3f5184fc-9b43-4a52-b403-a84f83b06b80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:24.339718 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3f5184fc-9b43-4a52-b403-a84f83b06b80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:24.348005 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3f5184fc-9b43-4a52-b403-a84f83b06b80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:24.349491 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3f5184fc-9b43-4a52-b403-a84f83b06b80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:24.350625 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3f5184fc-9b43-4a52-b403-a84f83b06b80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.162564 Aug 17 23:48:24.351689 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 354/713] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:24 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:24.731487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d5bff753-01e4-4948-a7b2-fd7958e9d538 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:24.732124 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d5bff753-01e4-4948-a7b2-fd7958e9d538 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:24.739535 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5bff753-01e4-4948-a7b2-fd7958e9d538 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:24.740035 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5bff753-01e4-4948-a7b2-fd7958e9d538 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:24.741374 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5bff753-01e4-4948-a7b2-fd7958e9d538 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:24.742150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5bff753-01e4-4948-a7b2-fd7958e9d538 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:24.742662 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5bff753-01e4-4948-a7b2-fd7958e9d538 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:24.743129 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5bff753-01e4-4948-a7b2-fd7958e9d538 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:24.882549 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d5bff753-01e4-4948-a7b2-fd7958e9d538 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:24.890796 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d5bff753-01e4-4948-a7b2-fd7958e9d538 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1722 microversion: 2.1 time: 0.162985 Aug 17 23:48:24.891381 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 360/714] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:24 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:25.375792 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-d39f852b-7871-4af5-af6a-8b26b58009e8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:25.376663 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-d39f852b-7871-4af5-af6a-8b26b58009e8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:25.384217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d39f852b-7871-4af5-af6a-8b26b58009e8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:25.384709 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d39f852b-7871-4af5-af6a-8b26b58009e8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:25.385149 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d39f852b-7871-4af5-af6a-8b26b58009e8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:25.385855 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d39f852b-7871-4af5-af6a-8b26b58009e8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:25.386313 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d39f852b-7871-4af5-af6a-8b26b58009e8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:25.386773 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d39f852b-7871-4af5-af6a-8b26b58009e8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:25.524609 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d39f852b-7871-4af5-af6a-8b26b58009e8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:25.533243 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d39f852b-7871-4af5-af6a-8b26b58009e8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:25.534746 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d39f852b-7871-4af5-af6a-8b26b58009e8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:25.535905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-d39f852b-7871-4af5-af6a-8b26b58009e8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.165565 Aug 17 23:48:25.536858 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 355/715] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:25 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:25.914171 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-23efcb35-635d-4489-831e-783dc59c0590 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:25.914774 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-23efcb35-635d-4489-831e-783dc59c0590 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:25.921269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-23efcb35-635d-4489-831e-783dc59c0590 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:25.921755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-23efcb35-635d-4489-831e-783dc59c0590 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:25.922195 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-23efcb35-635d-4489-831e-783dc59c0590 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:25.922890 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-23efcb35-635d-4489-831e-783dc59c0590 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:25.923348 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-23efcb35-635d-4489-831e-783dc59c0590 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:25.923774 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-23efcb35-635d-4489-831e-783dc59c0590 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:26.064709 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-23efcb35-635d-4489-831e-783dc59c0590 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:26.072754 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-23efcb35-635d-4489-831e-783dc59c0590 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1722 microversion: 2.1 time: 0.163396 Aug 17 23:48:26.073323 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 361/716] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:25 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:26.182165 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-694ed3d6-0e58-4136-b9d7-d1d31ad6c94f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29ec83ec-a285-443e-a8f3-92c83d6628a4"}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:48:26.184833 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-694ed3d6-0e58-4136-b9d7-d1d31ad6c94f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:26.193462 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-694ed3d6-0e58-4136-b9d7-d1d31ad6c94f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:26.193976 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-694ed3d6-0e58-4136-b9d7-d1d31ad6c94f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:26.194424 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-694ed3d6-0e58-4136-b9d7-d1d31ad6c94f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:26.195213 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-694ed3d6-0e58-4136-b9d7-d1d31ad6c94f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:26.195674 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-694ed3d6-0e58-4136-b9d7-d1d31ad6c94f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:26.196138 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-694ed3d6-0e58-4136-b9d7-d1d31ad6c94f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:26.558742 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-558ef79f-548f-4d6c-83d0-c14a5618508b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:26.559354 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-558ef79f-548f-4d6c-83d0-c14a5618508b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:26.566047 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-558ef79f-548f-4d6c-83d0-c14a5618508b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:26.566546 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-558ef79f-548f-4d6c-83d0-c14a5618508b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:26.566984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-558ef79f-548f-4d6c-83d0-c14a5618508b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:26.567694 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-558ef79f-548f-4d6c-83d0-c14a5618508b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:26.568188 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-558ef79f-548f-4d6c-83d0-c14a5618508b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:26.568616 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-558ef79f-548f-4d6c-83d0-c14a5618508b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:26.702914 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-558ef79f-548f-4d6c-83d0-c14a5618508b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:26.714118 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-558ef79f-548f-4d6c-83d0-c14a5618508b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:26.716207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-558ef79f-548f-4d6c-83d0-c14a5618508b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:26.717710 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-558ef79f-548f-4d6c-83d0-c14a5618508b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.162732 Aug 17 23:48:26.724411 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 362/717] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:26 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:48:27.094561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-6a410523-1a80-40e9-a63d-c3afccc600ba tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:27.095264 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-6a410523-1a80-40e9-a63d-c3afccc600ba tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:27.101943 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6a410523-1a80-40e9-a63d-c3afccc600ba tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:27.102432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6a410523-1a80-40e9-a63d-c3afccc600ba tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:27.102873 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6a410523-1a80-40e9-a63d-c3afccc600ba tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:27.103571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6a410523-1a80-40e9-a63d-c3afccc600ba tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:27.104052 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6a410523-1a80-40e9-a63d-c3afccc600ba tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:27.104480 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6a410523-1a80-40e9-a63d-c3afccc600ba tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:27.238896 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-6a410523-1a80-40e9-a63d-c3afccc600ba tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:27.247478 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-6a410523-1a80-40e9-a63d-c3afccc600ba tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1722 microversion: 2.1 time: 0.156767 Aug 17 23:48:27.248067 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 363/718] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:27 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:48:27.742214 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-eb831c45-a079-497c-900a-cfe2b34a50bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:27.743439 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-eb831c45-a079-497c-900a-cfe2b34a50bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:27.749795 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-eb831c45-a079-497c-900a-cfe2b34a50bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:27.750376 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-eb831c45-a079-497c-900a-cfe2b34a50bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:27.750890 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-eb831c45-a079-497c-900a-cfe2b34a50bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:27.751671 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-eb831c45-a079-497c-900a-cfe2b34a50bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:27.752219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-eb831c45-a079-497c-900a-cfe2b34a50bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:27.752712 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-eb831c45-a079-497c-900a-cfe2b34a50bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:27.908525 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-eb831c45-a079-497c-900a-cfe2b34a50bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:27.917865 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-eb831c45-a079-497c-900a-cfe2b34a50bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:27.919475 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-eb831c45-a079-497c-900a-cfe2b34a50bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:27.920827 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-eb831c45-a079-497c-900a-cfe2b34a50bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.182555 Aug 17 23:48:27.926636 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 364/719] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:27 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:48:28.268611 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a7003382-27b6-4170-8224-b51d179754d9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:28.269311 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a7003382-27b6-4170-8224-b51d179754d9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:28.275627 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a7003382-27b6-4170-8224-b51d179754d9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:28.276144 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a7003382-27b6-4170-8224-b51d179754d9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:28.276576 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a7003382-27b6-4170-8224-b51d179754d9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:28.277260 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a7003382-27b6-4170-8224-b51d179754d9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:28.277707 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a7003382-27b6-4170-8224-b51d179754d9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:28.278122 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a7003382-27b6-4170-8224-b51d179754d9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:28.293011 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=99 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:48:28.419421 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a7003382-27b6-4170-8224-b51d179754d9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:28.427279 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a7003382-27b6-4170-8224-b51d179754d9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1722 microversion: 2.1 time: 0.162492 Aug 17 23:48:28.427835 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 365/720] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:28 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:48:29.067139 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-5ad34631-0804-4309-823e-b08d6e1d31b4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:29.067787 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-5ad34631-0804-4309-823e-b08d6e1d31b4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:29.073691 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5ad34631-0804-4309-823e-b08d6e1d31b4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:29.074177 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5ad34631-0804-4309-823e-b08d6e1d31b4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:29.074616 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5ad34631-0804-4309-823e-b08d6e1d31b4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:29.075308 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5ad34631-0804-4309-823e-b08d6e1d31b4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:29.075765 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5ad34631-0804-4309-823e-b08d6e1d31b4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:29.076221 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5ad34631-0804-4309-823e-b08d6e1d31b4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:29.223773 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5ad34631-0804-4309-823e-b08d6e1d31b4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:29.234682 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5ad34631-0804-4309-823e-b08d6e1d31b4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:29.236209 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5ad34631-0804-4309-823e-b08d6e1d31b4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:29.237528 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-5ad34631-0804-4309-823e-b08d6e1d31b4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.297291 Aug 17 23:48:29.252668 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 366/721] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:28 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:48:29.455178 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-beabf0b6-ea55-473f-a14c-10729f603dcb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:29.455815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-beabf0b6-ea55-473f-a14c-10729f603dcb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:29.462815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-beabf0b6-ea55-473f-a14c-10729f603dcb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:29.463294 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-beabf0b6-ea55-473f-a14c-10729f603dcb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:29.463725 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-beabf0b6-ea55-473f-a14c-10729f603dcb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:29.464437 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-beabf0b6-ea55-473f-a14c-10729f603dcb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:29.464884 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-beabf0b6-ea55-473f-a14c-10729f603dcb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:29.465299 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-beabf0b6-ea55-473f-a14c-10729f603dcb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:29.605585 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-beabf0b6-ea55-473f-a14c-10729f603dcb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:29.621610 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-beabf0b6-ea55-473f-a14c-10729f603dcb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1722 microversion: 2.1 time: 0.172758 Aug 17 23:48:29.622393 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 367/722] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:29 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:30.262004 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-7bfa8bf6-e9ee-44b8-a4ca-da0fd4570cb0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:30.262614 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-7bfa8bf6-e9ee-44b8-a4ca-da0fd4570cb0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:30.269383 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7bfa8bf6-e9ee-44b8-a4ca-da0fd4570cb0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:30.269871 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7bfa8bf6-e9ee-44b8-a4ca-da0fd4570cb0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:30.270542 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7bfa8bf6-e9ee-44b8-a4ca-da0fd4570cb0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:30.271312 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7bfa8bf6-e9ee-44b8-a4ca-da0fd4570cb0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:30.271773 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7bfa8bf6-e9ee-44b8-a4ca-da0fd4570cb0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:30.272238 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7bfa8bf6-e9ee-44b8-a4ca-da0fd4570cb0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:30.425595 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-7bfa8bf6-e9ee-44b8-a4ca-da0fd4570cb0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:30.435034 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-7bfa8bf6-e9ee-44b8-a4ca-da0fd4570cb0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:30.436673 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-7bfa8bf6-e9ee-44b8-a4ca-da0fd4570cb0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:30.437933 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-7bfa8bf6-e9ee-44b8-a4ca-da0fd4570cb0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.180762 Aug 17 23:48:30.438906 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 368/723] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:30 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:48:30.642716 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-235a2e63-fb24-4343-b80c-a328af660ced tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:30.643432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-235a2e63-fb24-4343-b80c-a328af660ced tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:30.649752 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-235a2e63-fb24-4343-b80c-a328af660ced tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:30.650233 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-235a2e63-fb24-4343-b80c-a328af660ced tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:30.650673 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-235a2e63-fb24-4343-b80c-a328af660ced tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:30.651357 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-235a2e63-fb24-4343-b80c-a328af660ced tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:30.651809 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-235a2e63-fb24-4343-b80c-a328af660ced tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:30.652262 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-235a2e63-fb24-4343-b80c-a328af660ced tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:30.792393 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-235a2e63-fb24-4343-b80c-a328af660ced tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:30.801305 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-235a2e63-fb24-4343-b80c-a328af660ced tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1722 microversion: 2.1 time: 0.162413 Aug 17 23:48:30.801875 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 369/724] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:30 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:48:31.461955 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-dc077776-e2fe-481b-abfd-e64fdcd938a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:31.462596 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-dc077776-e2fe-481b-abfd-e64fdcd938a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:31.468581 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dc077776-e2fe-481b-abfd-e64fdcd938a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:31.469068 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dc077776-e2fe-481b-abfd-e64fdcd938a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:31.469506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dc077776-e2fe-481b-abfd-e64fdcd938a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:31.470193 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dc077776-e2fe-481b-abfd-e64fdcd938a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:31.470650 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dc077776-e2fe-481b-abfd-e64fdcd938a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:31.471071 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dc077776-e2fe-481b-abfd-e64fdcd938a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:31.599760 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dc077776-e2fe-481b-abfd-e64fdcd938a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:31.608124 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dc077776-e2fe-481b-abfd-e64fdcd938a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:31.609607 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dc077776-e2fe-481b-abfd-e64fdcd938a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:31.610760 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-dc077776-e2fe-481b-abfd-e64fdcd938a7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.153244 Aug 17 23:48:31.611314 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 370/725] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:31 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:48:31.822874 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-3cdeaf45-8579-4bd2-bb12-450e2980b4b6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:31.823485 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-3cdeaf45-8579-4bd2-bb12-450e2980b4b6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:31.829820 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3cdeaf45-8579-4bd2-bb12-450e2980b4b6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:31.830305 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3cdeaf45-8579-4bd2-bb12-450e2980b4b6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:31.830791 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3cdeaf45-8579-4bd2-bb12-450e2980b4b6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:31.831642 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3cdeaf45-8579-4bd2-bb12-450e2980b4b6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:31.831929 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3cdeaf45-8579-4bd2-bb12-450e2980b4b6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:31.832393 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3cdeaf45-8579-4bd2-bb12-450e2980b4b6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:31.957901 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-3cdeaf45-8579-4bd2-bb12-450e2980b4b6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:31.965896 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-3cdeaf45-8579-4bd2-bb12-450e2980b4b6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1722 microversion: 2.1 time: 0.147279 Aug 17 23:48:31.966454 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 371/726] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:31 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:48:32.633672 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-858f9774-2c85-4844-956d-92e1e76bde10 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:32.634209 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-858f9774-2c85-4844-956d-92e1e76bde10 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:32.640142 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-858f9774-2c85-4844-956d-92e1e76bde10 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:32.640662 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-858f9774-2c85-4844-956d-92e1e76bde10 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:32.641101 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-858f9774-2c85-4844-956d-92e1e76bde10 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:32.641782 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-858f9774-2c85-4844-956d-92e1e76bde10 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:32.642236 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-858f9774-2c85-4844-956d-92e1e76bde10 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:32.642662 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-858f9774-2c85-4844-956d-92e1e76bde10 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:32.773582 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-858f9774-2c85-4844-956d-92e1e76bde10 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:32.781887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-858f9774-2c85-4844-956d-92e1e76bde10 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:32.783384 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-858f9774-2c85-4844-956d-92e1e76bde10 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:32.784552 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-858f9774-2c85-4844-956d-92e1e76bde10 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.154946 Aug 17 23:48:32.785108 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 372/727] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:32 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:48:32.986638 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8a67c1be-cb59-48fe-b0c5-2b6a49d0e29f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:32.987575 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8a67c1be-cb59-48fe-b0c5-2b6a49d0e29f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:32.993899 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8a67c1be-cb59-48fe-b0c5-2b6a49d0e29f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:32.994373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8a67c1be-cb59-48fe-b0c5-2b6a49d0e29f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:32.994804 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8a67c1be-cb59-48fe-b0c5-2b6a49d0e29f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:32.995481 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8a67c1be-cb59-48fe-b0c5-2b6a49d0e29f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:32.995929 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8a67c1be-cb59-48fe-b0c5-2b6a49d0e29f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:32.996377 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8a67c1be-cb59-48fe-b0c5-2b6a49d0e29f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:33.122096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-8a67c1be-cb59-48fe-b0c5-2b6a49d0e29f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:33.130125 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8a67c1be-cb59-48fe-b0c5-2b6a49d0e29f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1722 microversion: 2.1 time: 0.147408 Aug 17 23:48:33.130689 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 373/728] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:32 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:48:33.808657 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-80526b0e-fc79-463f-86b6-d65d52f5e56a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:33.809285 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-80526b0e-fc79-463f-86b6-d65d52f5e56a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:33.815117 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-80526b0e-fc79-463f-86b6-d65d52f5e56a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:33.815631 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-80526b0e-fc79-463f-86b6-d65d52f5e56a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:33.816086 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-80526b0e-fc79-463f-86b6-d65d52f5e56a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:33.816761 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-80526b0e-fc79-463f-86b6-d65d52f5e56a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:33.817209 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-80526b0e-fc79-463f-86b6-d65d52f5e56a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:33.817624 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-80526b0e-fc79-463f-86b6-d65d52f5e56a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:33.948521 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-80526b0e-fc79-463f-86b6-d65d52f5e56a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:33.957191 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-80526b0e-fc79-463f-86b6-d65d52f5e56a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:33.958669 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-80526b0e-fc79-463f-86b6-d65d52f5e56a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:33.959804 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-80526b0e-fc79-463f-86b6-d65d52f5e56a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.155650 Aug 17 23:48:33.961027 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 374/729] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:33 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:48:34.150880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ade73c45-4a56-4d32-b09e-e24e33b81702 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:34.151474 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ade73c45-4a56-4d32-b09e-e24e33b81702 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:34.157860 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ade73c45-4a56-4d32-b09e-e24e33b81702 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:34.158423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ade73c45-4a56-4d32-b09e-e24e33b81702 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:34.158859 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ade73c45-4a56-4d32-b09e-e24e33b81702 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:34.159533 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ade73c45-4a56-4d32-b09e-e24e33b81702 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:34.160008 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ade73c45-4a56-4d32-b09e-e24e33b81702 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:34.160426 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ade73c45-4a56-4d32-b09e-e24e33b81702 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:34.285344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ade73c45-4a56-4d32-b09e-e24e33b81702 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:34.293499 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ade73c45-4a56-4d32-b09e-e24e33b81702 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1722 microversion: 2.1 time: 0.146430 Aug 17 23:48:34.294077 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 375/730] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:34 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:48:34.983781 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-08a38e06-4112-45d1-a1df-1d204d998ce2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:34.984445 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-08a38e06-4112-45d1-a1df-1d204d998ce2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:34.990792 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08a38e06-4112-45d1-a1df-1d204d998ce2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:34.991295 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08a38e06-4112-45d1-a1df-1d204d998ce2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:34.991727 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08a38e06-4112-45d1-a1df-1d204d998ce2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:34.992438 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08a38e06-4112-45d1-a1df-1d204d998ce2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:34.992901 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08a38e06-4112-45d1-a1df-1d204d998ce2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:34.993307 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08a38e06-4112-45d1-a1df-1d204d998ce2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:35.129705 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-08a38e06-4112-45d1-a1df-1d204d998ce2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:35.138308 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-08a38e06-4112-45d1-a1df-1d204d998ce2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:35.139789 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-08a38e06-4112-45d1-a1df-1d204d998ce2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:35.140968 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-08a38e06-4112-45d1-a1df-1d204d998ce2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.162094 Aug 17 23:48:35.141519 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 376/731] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:34 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:48:35.314780 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-bf951a52-d0c9-48e3-9661-824b45b2a768 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:35.315481 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-bf951a52-d0c9-48e3-9661-824b45b2a768 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:35.322326 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bf951a52-d0c9-48e3-9661-824b45b2a768 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:35.322964 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bf951a52-d0c9-48e3-9661-824b45b2a768 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:35.323402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bf951a52-d0c9-48e3-9661-824b45b2a768 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:35.324126 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bf951a52-d0c9-48e3-9661-824b45b2a768 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:35.324662 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bf951a52-d0c9-48e3-9661-824b45b2a768 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:35.325113 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bf951a52-d0c9-48e3-9661-824b45b2a768 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:35.375642 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-694ed3d6-0e58-4136-b9d7-d1d31ad6c94f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "POST /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.295313 Aug 17 23:48:35.376598 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 356/732] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 17 23:48:26 2022] POST /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/os-volume_attachments => generated 194 bytes in 9297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:48:35.459631 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-bf951a52-d0c9-48e3-9661-824b45b2a768 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:35.468188 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-bf951a52-d0c9-48e3-9661-824b45b2a768 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1699 microversion: 2.1 time: 0.157186 Aug 17 23:48:35.468752 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 377/733] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:35 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1699 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:35.489820 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-05fca6d9-c6d8-4296-a2fa-00e6d63e720b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:48:35.496024 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-05fca6d9-c6d8-4296-a2fa-00e6d63e720b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:35.496507 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-05fca6d9-c6d8-4296-a2fa-00e6d63e720b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:35.496944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-05fca6d9-c6d8-4296-a2fa-00e6d63e720b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:35.519227 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-05fca6d9-c6d8-4296-a2fa-00e6d63e720b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Going to try to start instance {{(pid=131395) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 17 23:48:35.558870 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-05fca6d9-c6d8-4296-a2fa-00e6d63e720b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "POST /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227/action" status: 202 len: 0 microversion: 2.1 time: 0.073588 Aug 17 23:48:35.559476 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 357/734] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 17 23:48:35 2022] POST /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:48:35.567629 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c02a5afa-a1f2-4477-a739-e7544e2e1340 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:35.568268 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c02a5afa-a1f2-4477-a739-e7544e2e1340 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:35.574633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c02a5afa-a1f2-4477-a739-e7544e2e1340 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:35.575057 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c02a5afa-a1f2-4477-a739-e7544e2e1340 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:35.575490 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c02a5afa-a1f2-4477-a739-e7544e2e1340 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:35.576203 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c02a5afa-a1f2-4477-a739-e7544e2e1340 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:35.576659 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c02a5afa-a1f2-4477-a739-e7544e2e1340 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:35.577083 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c02a5afa-a1f2-4477-a739-e7544e2e1340 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:35.706777 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c02a5afa-a1f2-4477-a739-e7544e2e1340 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:35.716825 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c02a5afa-a1f2-4477-a739-e7544e2e1340 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1708 microversion: 2.1 time: 0.153043 Aug 17 23:48:35.717387 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 378/735] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:35 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1708 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:36.165945 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-af8b2382-0e0e-468e-9f60-5b6945ad5ab7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:36.166647 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-af8b2382-0e0e-468e-9f60-5b6945ad5ab7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:36.172941 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-af8b2382-0e0e-468e-9f60-5b6945ad5ab7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:36.173306 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-af8b2382-0e0e-468e-9f60-5b6945ad5ab7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:36.173992 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-af8b2382-0e0e-468e-9f60-5b6945ad5ab7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:36.174798 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-af8b2382-0e0e-468e-9f60-5b6945ad5ab7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:36.175257 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-af8b2382-0e0e-468e-9f60-5b6945ad5ab7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:36.175684 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-af8b2382-0e0e-468e-9f60-5b6945ad5ab7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:36.306570 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-af8b2382-0e0e-468e-9f60-5b6945ad5ab7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:36.314981 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-af8b2382-0e0e-468e-9f60-5b6945ad5ab7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:36.316482 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-af8b2382-0e0e-468e-9f60-5b6945ad5ab7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:36.317626 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-af8b2382-0e0e-468e-9f60-5b6945ad5ab7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.157427 Aug 17 23:48:36.318179 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 358/736] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:36 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:36.737733 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e14f86c3-3614-466e-b986-148130a91209 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:36.738404 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e14f86c3-3614-466e-b986-148130a91209 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:36.740768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=64 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:48:36.746435 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e14f86c3-3614-466e-b986-148130a91209 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:36.746917 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e14f86c3-3614-466e-b986-148130a91209 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:36.747355 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e14f86c3-3614-466e-b986-148130a91209 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:36.748066 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e14f86c3-3614-466e-b986-148130a91209 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:36.748524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e14f86c3-3614-466e-b986-148130a91209 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:36.748947 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e14f86c3-3614-466e-b986-148130a91209 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:36.877610 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e14f86c3-3614-466e-b986-148130a91209 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:36.885481 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e14f86c3-3614-466e-b986-148130a91209 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1708 microversion: 2.1 time: 0.151595 Aug 17 23:48:36.886280 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 379/737] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:36 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:37.340729 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-15e66651-72aa-41f1-88af-2b503999e51d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:37.341341 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-15e66651-72aa-41f1-88af-2b503999e51d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:37.347823 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-15e66651-72aa-41f1-88af-2b503999e51d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:37.348342 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-15e66651-72aa-41f1-88af-2b503999e51d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:37.348782 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-15e66651-72aa-41f1-88af-2b503999e51d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:37.349471 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-15e66651-72aa-41f1-88af-2b503999e51d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:37.349922 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-15e66651-72aa-41f1-88af-2b503999e51d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:37.350340 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-15e66651-72aa-41f1-88af-2b503999e51d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:37.355102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:48:37.497900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-15e66651-72aa-41f1-88af-2b503999e51d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:37.507916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-15e66651-72aa-41f1-88af-2b503999e51d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:37.509460 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-15e66651-72aa-41f1-88af-2b503999e51d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:37.510711 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-15e66651-72aa-41f1-88af-2b503999e51d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.173843 Aug 17 23:48:37.524766 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 359/738] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:37 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:37.906133 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-464eb9e2-5f07-4a5c-852c-8f265da3a46e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:37.906680 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-464eb9e2-5f07-4a5c-852c-8f265da3a46e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:37.914019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-464eb9e2-5f07-4a5c-852c-8f265da3a46e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:37.914536 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-464eb9e2-5f07-4a5c-852c-8f265da3a46e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:37.914982 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-464eb9e2-5f07-4a5c-852c-8f265da3a46e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:37.915670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-464eb9e2-5f07-4a5c-852c-8f265da3a46e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:37.916171 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-464eb9e2-5f07-4a5c-852c-8f265da3a46e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:37.916599 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-464eb9e2-5f07-4a5c-852c-8f265da3a46e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:38.047362 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-464eb9e2-5f07-4a5c-852c-8f265da3a46e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:38.057103 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-464eb9e2-5f07-4a5c-852c-8f265da3a46e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1708 microversion: 2.1 time: 0.153813 Aug 17 23:48:38.057672 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 380/739] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:37 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1708 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:38.534185 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-738c8210-e3ef-4540-bf07-ccacd45a042d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:38.534799 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-738c8210-e3ef-4540-bf07-ccacd45a042d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:38.541432 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-738c8210-e3ef-4540-bf07-ccacd45a042d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:38.541907 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-738c8210-e3ef-4540-bf07-ccacd45a042d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:38.542338 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-738c8210-e3ef-4540-bf07-ccacd45a042d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:38.543025 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-738c8210-e3ef-4540-bf07-ccacd45a042d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:38.543481 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-738c8210-e3ef-4540-bf07-ccacd45a042d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:38.543897 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-738c8210-e3ef-4540-bf07-ccacd45a042d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:38.675434 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-738c8210-e3ef-4540-bf07-ccacd45a042d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:38.684230 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-738c8210-e3ef-4540-bf07-ccacd45a042d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:38.685719 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-738c8210-e3ef-4540-bf07-ccacd45a042d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:38.686860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-738c8210-e3ef-4540-bf07-ccacd45a042d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.156595 Aug 17 23:48:38.687413 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 360/740] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:38 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:39.078584 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ba45ca55-786d-4974-b473-4afacd439f7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:39.079203 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ba45ca55-786d-4974-b473-4afacd439f7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:39.085667 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ba45ca55-786d-4974-b473-4afacd439f7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:39.086154 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ba45ca55-786d-4974-b473-4afacd439f7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:39.086593 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ba45ca55-786d-4974-b473-4afacd439f7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:39.087294 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ba45ca55-786d-4974-b473-4afacd439f7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:39.087757 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ba45ca55-786d-4974-b473-4afacd439f7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:39.088224 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ba45ca55-786d-4974-b473-4afacd439f7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:39.218277 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ba45ca55-786d-4974-b473-4afacd439f7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:39.228085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ba45ca55-786d-4974-b473-4afacd439f7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1708 microversion: 2.1 time: 0.153336 Aug 17 23:48:39.228661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 381/741] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:39 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1708 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:39.710263 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ccbb866c-d258-4521-8a0a-3d99eb149af7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:39.710834 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ccbb866c-d258-4521-8a0a-3d99eb149af7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:39.717172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccbb866c-d258-4521-8a0a-3d99eb149af7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:39.717659 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccbb866c-d258-4521-8a0a-3d99eb149af7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:39.718101 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccbb866c-d258-4521-8a0a-3d99eb149af7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:39.718794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccbb866c-d258-4521-8a0a-3d99eb149af7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:39.719254 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccbb866c-d258-4521-8a0a-3d99eb149af7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:39.719680 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccbb866c-d258-4521-8a0a-3d99eb149af7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:39.847603 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ccbb866c-d258-4521-8a0a-3d99eb149af7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:39.856066 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ccbb866c-d258-4521-8a0a-3d99eb149af7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:39.857569 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ccbb866c-d258-4521-8a0a-3d99eb149af7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:39.858717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ccbb866c-d258-4521-8a0a-3d99eb149af7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.152837 Aug 17 23:48:39.859282 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 361/742] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:39 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:40.249912 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-099b569e-aa11-46d3-be94-3e9fec29a71b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:40.250548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-099b569e-aa11-46d3-be94-3e9fec29a71b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:40.257514 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-099b569e-aa11-46d3-be94-3e9fec29a71b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:40.257991 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-099b569e-aa11-46d3-be94-3e9fec29a71b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:40.258424 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-099b569e-aa11-46d3-be94-3e9fec29a71b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:40.259108 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-099b569e-aa11-46d3-be94-3e9fec29a71b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:40.259563 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-099b569e-aa11-46d3-be94-3e9fec29a71b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:40.260018 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-099b569e-aa11-46d3-be94-3e9fec29a71b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:40.262509 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=100 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:48:40.389015 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-099b569e-aa11-46d3-be94-3e9fec29a71b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:40.396898 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-099b569e-aa11-46d3-be94-3e9fec29a71b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1712 microversion: 2.1 time: 0.150893 Aug 17 23:48:40.397464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 382/743] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:40 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1712 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:40.880463 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b9db6cff-cb34-4c99-94b1-f5bc55d2562e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:40.881098 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b9db6cff-cb34-4c99-94b1-f5bc55d2562e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:40.887369 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b9db6cff-cb34-4c99-94b1-f5bc55d2562e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:40.887851 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b9db6cff-cb34-4c99-94b1-f5bc55d2562e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:40.888348 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b9db6cff-cb34-4c99-94b1-f5bc55d2562e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:40.889031 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b9db6cff-cb34-4c99-94b1-f5bc55d2562e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:40.889486 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b9db6cff-cb34-4c99-94b1-f5bc55d2562e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:40.889905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b9db6cff-cb34-4c99-94b1-f5bc55d2562e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:41.018639 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b9db6cff-cb34-4c99-94b1-f5bc55d2562e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:41.027584 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b9db6cff-cb34-4c99-94b1-f5bc55d2562e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:41.029111 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b9db6cff-cb34-4c99-94b1-f5bc55d2562e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:41.030293 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b9db6cff-cb34-4c99-94b1-f5bc55d2562e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.153644 Aug 17 23:48:41.030857 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 362/744] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:40 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:42.054453 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-568b0041-72d6-4c5a-b763-79bee0a74824 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:42.054999 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-568b0041-72d6-4c5a-b763-79bee0a74824 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:42.061435 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-568b0041-72d6-4c5a-b763-79bee0a74824 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:42.061914 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-568b0041-72d6-4c5a-b763-79bee0a74824 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:42.062347 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-568b0041-72d6-4c5a-b763-79bee0a74824 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:42.063030 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-568b0041-72d6-4c5a-b763-79bee0a74824 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:42.063485 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-568b0041-72d6-4c5a-b763-79bee0a74824 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:42.063908 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-568b0041-72d6-4c5a-b763-79bee0a74824 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:42.193427 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-568b0041-72d6-4c5a-b763-79bee0a74824 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:42.201754 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-568b0041-72d6-4c5a-b763-79bee0a74824 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:42.203247 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-568b0041-72d6-4c5a-b763-79bee0a74824 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:42.204421 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-568b0041-72d6-4c5a-b763-79bee0a74824 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.154617 Aug 17 23:48:42.204975 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 383/745] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:42 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:43.227214 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-efc0ac35-1c2d-4064-b057-3ea232ee4a2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:43.227870 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-efc0ac35-1c2d-4064-b057-3ea232ee4a2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:43.234185 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-efc0ac35-1c2d-4064-b057-3ea232ee4a2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:43.234658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-efc0ac35-1c2d-4064-b057-3ea232ee4a2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:43.235089 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-efc0ac35-1c2d-4064-b057-3ea232ee4a2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:43.235767 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-efc0ac35-1c2d-4064-b057-3ea232ee4a2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:43.236249 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-efc0ac35-1c2d-4064-b057-3ea232ee4a2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:43.236666 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-efc0ac35-1c2d-4064-b057-3ea232ee4a2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:43.364756 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-efc0ac35-1c2d-4064-b057-3ea232ee4a2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:43.373622 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-efc0ac35-1c2d-4064-b057-3ea232ee4a2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:43.375109 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-efc0ac35-1c2d-4064-b057-3ea232ee4a2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:43.376277 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-efc0ac35-1c2d-4064-b057-3ea232ee4a2d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.152993 Aug 17 23:48:43.376831 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 363/746] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:43 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:44.399188 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-01252a18-13f0-427c-b420-df1114bff6b6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:44.399796 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-01252a18-13f0-427c-b420-df1114bff6b6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:44.406283 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-01252a18-13f0-427c-b420-df1114bff6b6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:44.406712 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-01252a18-13f0-427c-b420-df1114bff6b6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:44.407147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-01252a18-13f0-427c-b420-df1114bff6b6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:44.407833 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-01252a18-13f0-427c-b420-df1114bff6b6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:44.408322 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-01252a18-13f0-427c-b420-df1114bff6b6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:44.408746 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-01252a18-13f0-427c-b420-df1114bff6b6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:44.540394 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-01252a18-13f0-427c-b420-df1114bff6b6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:44.549146 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-01252a18-13f0-427c-b420-df1114bff6b6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:44.550641 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-01252a18-13f0-427c-b420-df1114bff6b6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:44.551787 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-01252a18-13f0-427c-b420-df1114bff6b6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.157110 Aug 17 23:48:44.552378 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 384/747] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:44 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:45.575290 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-fcbcec78-db9e-41ef-8e95-5148f2d7a59d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:45.575905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-fcbcec78-db9e-41ef-8e95-5148f2d7a59d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:45.582410 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fcbcec78-db9e-41ef-8e95-5148f2d7a59d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:45.582896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fcbcec78-db9e-41ef-8e95-5148f2d7a59d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:45.583342 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fcbcec78-db9e-41ef-8e95-5148f2d7a59d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:45.584072 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fcbcec78-db9e-41ef-8e95-5148f2d7a59d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:45.585046 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fcbcec78-db9e-41ef-8e95-5148f2d7a59d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:45.585478 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fcbcec78-db9e-41ef-8e95-5148f2d7a59d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:45.715627 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-fcbcec78-db9e-41ef-8e95-5148f2d7a59d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:45.725876 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-fcbcec78-db9e-41ef-8e95-5148f2d7a59d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:45.727389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-fcbcec78-db9e-41ef-8e95-5148f2d7a59d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:45.728696 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-fcbcec78-db9e-41ef-8e95-5148f2d7a59d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.157383 Aug 17 23:48:45.729258 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 364/748] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:45 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:46.090781 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9a490d8a-434f-4199-b7da-eccca33a2c4b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:48:46.093081 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9a490d8a-434f-4199-b7da-eccca33a2c4b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:46.099374 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9a490d8a-434f-4199-b7da-eccca33a2c4b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:46.099850 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9a490d8a-434f-4199-b7da-eccca33a2c4b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:46.100360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9a490d8a-434f-4199-b7da-eccca33a2c4b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:46.101040 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9a490d8a-434f-4199-b7da-eccca33a2c4b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:46.101487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9a490d8a-434f-4199-b7da-eccca33a2c4b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:46.101904 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9a490d8a-434f-4199-b7da-eccca33a2c4b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:46.124129 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.objects.instance [None req-9a490d8a-434f-4199-b7da-eccca33a2c4b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lazy-loading 'flavor' on Instance uuid 20b73d6d-ce40-4adb-bbd2-7ac326eb758a {{(pid=131394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:48:46.238512 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9a490d8a-434f-4199-b7da-eccca33a2c4b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "POST /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/action" status: 200 len: 32 microversion: 2.1 time: 0.151561 Aug 17 23:48:46.239028 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 385/749] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 17 23:48:46 2022] POST /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/action => generated 32 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 23:48:46.248903 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f2cb5d14-c6dc-495b-a828-2b5875443c3a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:46.249505 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f2cb5d14-c6dc-495b-a828-2b5875443c3a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:46.255510 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2cb5d14-c6dc-495b-a828-2b5875443c3a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:46.256054 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2cb5d14-c6dc-495b-a828-2b5875443c3a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:46.257149 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2cb5d14-c6dc-495b-a828-2b5875443c3a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:46.257796 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2cb5d14-c6dc-495b-a828-2b5875443c3a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:46.258331 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2cb5d14-c6dc-495b-a828-2b5875443c3a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:46.258676 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2cb5d14-c6dc-495b-a828-2b5875443c3a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:46.472451 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f2cb5d14-c6dc-495b-a828-2b5875443c3a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:46.480974 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f2cb5d14-c6dc-495b-a828-2b5875443c3a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1733 microversion: 2.1 time: 0.235811 Aug 17 23:48:46.481638 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 365/750] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:46 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1733 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:46.752764 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-6eba298c-229f-43c5-8773-62a17b7a8ed0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:46.753469 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-6eba298c-229f-43c5-8773-62a17b7a8ed0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:46.759679 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6eba298c-229f-43c5-8773-62a17b7a8ed0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:46.760204 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6eba298c-229f-43c5-8773-62a17b7a8ed0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:46.760647 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6eba298c-229f-43c5-8773-62a17b7a8ed0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:46.761341 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6eba298c-229f-43c5-8773-62a17b7a8ed0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:46.761801 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6eba298c-229f-43c5-8773-62a17b7a8ed0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:46.762230 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6eba298c-229f-43c5-8773-62a17b7a8ed0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:46.894420 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-6eba298c-229f-43c5-8773-62a17b7a8ed0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:46.903487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-6eba298c-229f-43c5-8773-62a17b7a8ed0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:46.905027 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-6eba298c-229f-43c5-8773-62a17b7a8ed0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:46.906191 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-6eba298c-229f-43c5-8773-62a17b7a8ed0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.158142 Aug 17 23:48:46.906748 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 386/751] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:46 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:47.501583 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c04e03bf-133d-4e29-b12f-034fba60a5c0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:47.502193 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c04e03bf-133d-4e29-b12f-034fba60a5c0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:47.504551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=38 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:48:47.510151 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c04e03bf-133d-4e29-b12f-034fba60a5c0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:47.510630 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c04e03bf-133d-4e29-b12f-034fba60a5c0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:47.511061 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c04e03bf-133d-4e29-b12f-034fba60a5c0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:47.511744 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c04e03bf-133d-4e29-b12f-034fba60a5c0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:47.512216 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c04e03bf-133d-4e29-b12f-034fba60a5c0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:47.512634 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c04e03bf-133d-4e29-b12f-034fba60a5c0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:47.639359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c04e03bf-133d-4e29-b12f-034fba60a5c0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:47.647142 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c04e03bf-133d-4e29-b12f-034fba60a5c0 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1733 microversion: 2.1 time: 0.149409 Aug 17 23:48:47.647702 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 366/752] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:47 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:47.930165 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-31abc5bb-4a2b-4ad9-b221-4f6030be1c6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:47.930775 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-31abc5bb-4a2b-4ad9-b221-4f6030be1c6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:47.937116 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-31abc5bb-4a2b-4ad9-b221-4f6030be1c6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:47.937589 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-31abc5bb-4a2b-4ad9-b221-4f6030be1c6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:47.938024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-31abc5bb-4a2b-4ad9-b221-4f6030be1c6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:47.938705 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-31abc5bb-4a2b-4ad9-b221-4f6030be1c6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:47.939158 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-31abc5bb-4a2b-4ad9-b221-4f6030be1c6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:47.939579 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-31abc5bb-4a2b-4ad9-b221-4f6030be1c6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:48.073584 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-45ae426e-8993-4737-a82d-5585dff6460c req-3752c577-6e95-40c1-aa28-9ba699c9c94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abc34597-7782-4715-86c3-6a940ecde323", "name": "network-vif-plugged", "status": "completed", "tag": "bce8dab3-ded2-46e7-a72a-7a52eb3c9201"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:48:48.082486 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-31abc5bb-4a2b-4ad9-b221-4f6030be1c6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:48.087598 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-45ae426e-8993-4737-a82d-5585dff6460c req-3752c577-6e95-40c1-aa28-9ba699c9c94b service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:48.088119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-45ae426e-8993-4737-a82d-5585dff6460c req-3752c577-6e95-40c1-aa28-9ba699c9c94b service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:48.088553 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-45ae426e-8993-4737-a82d-5585dff6460c req-3752c577-6e95-40c1-aa28-9ba699c9c94b service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:48.097535 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-31abc5bb-4a2b-4ad9-b221-4f6030be1c6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:48.099031 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-31abc5bb-4a2b-4ad9-b221-4f6030be1c6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:48.100712 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-45ae426e-8993-4737-a82d-5585dff6460c req-3752c577-6e95-40c1-aa28-9ba699c9c94b service nova] Creating event network-vif-plugged:bce8dab3-ded2-46e7-a72a-7a52eb3c9201 for instance abc34597-7782-4715-86c3-6a940ecde323 on hv-cinder-82002 Aug 17 23:48:48.100851 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-31abc5bb-4a2b-4ad9-b221-4f6030be1c6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.174462 Aug 17 23:48:48.101271 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 387/753] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:47 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:48.106599 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-45ae426e-8993-4737-a82d-5585dff6460c req-3752c577-6e95-40c1-aa28-9ba699c9c94b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037175 Aug 17 23:48:48.107658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 367/754] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:48:48.668707 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e75c0587-3d2d-427f-832e-c3c62c4f81b6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:48.669263 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e75c0587-3d2d-427f-832e-c3c62c4f81b6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:48.675072 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e75c0587-3d2d-427f-832e-c3c62c4f81b6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:48.675551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e75c0587-3d2d-427f-832e-c3c62c4f81b6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:48.676005 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e75c0587-3d2d-427f-832e-c3c62c4f81b6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:48.676684 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e75c0587-3d2d-427f-832e-c3c62c4f81b6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:48.677136 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e75c0587-3d2d-427f-832e-c3c62c4f81b6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:48.677550 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e75c0587-3d2d-427f-832e-c3c62c4f81b6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:48.811826 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e75c0587-3d2d-427f-832e-c3c62c4f81b6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:48.820699 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e75c0587-3d2d-427f-832e-c3c62c4f81b6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1733 microversion: 2.1 time: 0.155860 Aug 17 23:48:48.821290 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 388/755] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:48 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:49.124734 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9616dc03-7bd1-4600-b2e5-66c1317277db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:49.125437 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9616dc03-7bd1-4600-b2e5-66c1317277db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:49.132740 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9616dc03-7bd1-4600-b2e5-66c1317277db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:49.133227 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9616dc03-7bd1-4600-b2e5-66c1317277db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:49.133664 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9616dc03-7bd1-4600-b2e5-66c1317277db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:49.134351 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9616dc03-7bd1-4600-b2e5-66c1317277db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:49.134808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9616dc03-7bd1-4600-b2e5-66c1317277db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:49.135230 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9616dc03-7bd1-4600-b2e5-66c1317277db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:49.262702 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9616dc03-7bd1-4600-b2e5-66c1317277db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:49.270995 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9616dc03-7bd1-4600-b2e5-66c1317277db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:49.272524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9616dc03-7bd1-4600-b2e5-66c1317277db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:49.273685 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9616dc03-7bd1-4600-b2e5-66c1317277db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.153262 Aug 17 23:48:49.274240 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 368/756] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:49 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:49.842074 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-3913ce41-3186-4cc5-b9c0-2b6894594cf3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:49.842718 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-3913ce41-3186-4cc5-b9c0-2b6894594cf3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:49.849196 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3913ce41-3186-4cc5-b9c0-2b6894594cf3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:49.849675 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3913ce41-3186-4cc5-b9c0-2b6894594cf3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:49.850112 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3913ce41-3186-4cc5-b9c0-2b6894594cf3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:49.850795 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3913ce41-3186-4cc5-b9c0-2b6894594cf3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:49.851276 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3913ce41-3186-4cc5-b9c0-2b6894594cf3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:49.852356 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3913ce41-3186-4cc5-b9c0-2b6894594cf3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:49.980272 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-3913ce41-3186-4cc5-b9c0-2b6894594cf3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:49.988178 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-3913ce41-3186-4cc5-b9c0-2b6894594cf3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1733 microversion: 2.1 time: 0.149973 Aug 17 23:48:49.988744 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 389/757] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:49 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:50.296648 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-576fc79c-2851-47fb-ad41-52e1d0dd5fce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:50.297274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-576fc79c-2851-47fb-ad41-52e1d0dd5fce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:50.303740 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-576fc79c-2851-47fb-ad41-52e1d0dd5fce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:50.304260 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-576fc79c-2851-47fb-ad41-52e1d0dd5fce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:50.304701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-576fc79c-2851-47fb-ad41-52e1d0dd5fce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:50.305396 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-576fc79c-2851-47fb-ad41-52e1d0dd5fce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:50.305858 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-576fc79c-2851-47fb-ad41-52e1d0dd5fce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:50.306284 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-576fc79c-2851-47fb-ad41-52e1d0dd5fce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:50.437005 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-576fc79c-2851-47fb-ad41-52e1d0dd5fce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:50.446083 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-576fc79c-2851-47fb-ad41-52e1d0dd5fce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:50.447601 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-576fc79c-2851-47fb-ad41-52e1d0dd5fce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:50.448795 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-576fc79c-2851-47fb-ad41-52e1d0dd5fce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.156007 Aug 17 23:48:50.449359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 369/758] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:50 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:51.008733 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-09fa80a9-a736-4e26-a1f9-d8efa8aadd69 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:51.009341 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-09fa80a9-a736-4e26-a1f9-d8efa8aadd69 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:51.015925 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-09fa80a9-a736-4e26-a1f9-d8efa8aadd69 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:51.016447 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-09fa80a9-a736-4e26-a1f9-d8efa8aadd69 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:51.016880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-09fa80a9-a736-4e26-a1f9-d8efa8aadd69 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:51.017593 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-09fa80a9-a736-4e26-a1f9-d8efa8aadd69 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:51.018052 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-09fa80a9-a736-4e26-a1f9-d8efa8aadd69 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:51.018474 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-09fa80a9-a736-4e26-a1f9-d8efa8aadd69 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:51.145337 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-09fa80a9-a736-4e26-a1f9-d8efa8aadd69 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:51.153354 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-09fa80a9-a736-4e26-a1f9-d8efa8aadd69 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1733 microversion: 2.1 time: 0.148866 Aug 17 23:48:51.153918 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 390/759] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:51 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:51.472168 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-58d41e5f-5e0e-4e45-b87e-eba6ff887673 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:51.472774 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-58d41e5f-5e0e-4e45-b87e-eba6ff887673 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:51.479695 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-58d41e5f-5e0e-4e45-b87e-eba6ff887673 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:51.480205 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-58d41e5f-5e0e-4e45-b87e-eba6ff887673 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:51.480636 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-58d41e5f-5e0e-4e45-b87e-eba6ff887673 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:51.481316 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-58d41e5f-5e0e-4e45-b87e-eba6ff887673 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:51.481767 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-58d41e5f-5e0e-4e45-b87e-eba6ff887673 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:51.482186 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-58d41e5f-5e0e-4e45-b87e-eba6ff887673 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:51.608462 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-58d41e5f-5e0e-4e45-b87e-eba6ff887673 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:51.616707 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-58d41e5f-5e0e-4e45-b87e-eba6ff887673 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:51.618349 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-58d41e5f-5e0e-4e45-b87e-eba6ff887673 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:51.619506 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-58d41e5f-5e0e-4e45-b87e-eba6ff887673 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.151244 Aug 17 23:48:51.620071 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 370/760] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:51 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:52.174773 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-034284b0-6307-44ef-9269-8d535a885097 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:52.175380 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-034284b0-6307-44ef-9269-8d535a885097 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:52.182202 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-034284b0-6307-44ef-9269-8d535a885097 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:52.182679 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-034284b0-6307-44ef-9269-8d535a885097 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:52.183110 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-034284b0-6307-44ef-9269-8d535a885097 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:52.183785 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-034284b0-6307-44ef-9269-8d535a885097 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:52.184331 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-034284b0-6307-44ef-9269-8d535a885097 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:52.184752 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-034284b0-6307-44ef-9269-8d535a885097 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:52.310993 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-034284b0-6307-44ef-9269-8d535a885097 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:52.319021 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-034284b0-6307-44ef-9269-8d535a885097 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1733 microversion: 2.1 time: 0.148060 Aug 17 23:48:52.319574 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 391/761] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:52 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:52.642285 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-7a5117fe-40f7-4fca-ba6e-3383b08c67ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:52.642902 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-7a5117fe-40f7-4fca-ba6e-3383b08c67ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:52.649331 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7a5117fe-40f7-4fca-ba6e-3383b08c67ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:52.649821 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7a5117fe-40f7-4fca-ba6e-3383b08c67ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:52.650263 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7a5117fe-40f7-4fca-ba6e-3383b08c67ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:52.650957 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7a5117fe-40f7-4fca-ba6e-3383b08c67ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:52.651420 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7a5117fe-40f7-4fca-ba6e-3383b08c67ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:52.651849 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7a5117fe-40f7-4fca-ba6e-3383b08c67ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:52.776495 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7a5117fe-40f7-4fca-ba6e-3383b08c67ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:52.784806 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7a5117fe-40f7-4fca-ba6e-3383b08c67ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:52.786308 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7a5117fe-40f7-4fca-ba6e-3383b08c67ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:52.787729 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-7a5117fe-40f7-4fca-ba6e-3383b08c67ab tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.149372 Aug 17 23:48:52.788320 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 371/762] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:52 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:53.341294 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8ab3ec68-4f93-4744-a9a8-8df14cc73beb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:53.341935 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8ab3ec68-4f93-4744-a9a8-8df14cc73beb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:53.348261 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8ab3ec68-4f93-4744-a9a8-8df14cc73beb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:53.348746 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8ab3ec68-4f93-4744-a9a8-8df14cc73beb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:53.349184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8ab3ec68-4f93-4744-a9a8-8df14cc73beb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:53.349869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8ab3ec68-4f93-4744-a9a8-8df14cc73beb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:53.350324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8ab3ec68-4f93-4744-a9a8-8df14cc73beb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:53.350747 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8ab3ec68-4f93-4744-a9a8-8df14cc73beb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:53.484061 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-8ab3ec68-4f93-4744-a9a8-8df14cc73beb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:53.491981 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8ab3ec68-4f93-4744-a9a8-8df14cc73beb tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1733 microversion: 2.1 time: 0.154514 Aug 17 23:48:53.492538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 392/763] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:53 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:53.811342 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-05d18fe7-e854-4bdf-8e88-2e1f65e112fa tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:53.811955 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-05d18fe7-e854-4bdf-8e88-2e1f65e112fa tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:53.818297 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-05d18fe7-e854-4bdf-8e88-2e1f65e112fa tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:53.818785 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-05d18fe7-e854-4bdf-8e88-2e1f65e112fa tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:53.819227 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-05d18fe7-e854-4bdf-8e88-2e1f65e112fa tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:53.820533 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-05d18fe7-e854-4bdf-8e88-2e1f65e112fa tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:53.821011 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-05d18fe7-e854-4bdf-8e88-2e1f65e112fa tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:53.821443 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-05d18fe7-e854-4bdf-8e88-2e1f65e112fa tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:53.950337 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-05d18fe7-e854-4bdf-8e88-2e1f65e112fa tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:53.958665 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-05d18fe7-e854-4bdf-8e88-2e1f65e112fa tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:53.960200 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-05d18fe7-e854-4bdf-8e88-2e1f65e112fa tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:53.961388 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-05d18fe7-e854-4bdf-8e88-2e1f65e112fa tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1808 microversion: 2.20 time: 0.153887 Aug 17 23:48:53.961960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 372/764] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:53 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:54.512888 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ae9822c5-df38-4530-b4c8-2e5319300d76 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:54.513527 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ae9822c5-df38-4530-b4c8-2e5319300d76 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:54.519917 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ae9822c5-df38-4530-b4c8-2e5319300d76 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:54.520459 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ae9822c5-df38-4530-b4c8-2e5319300d76 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:54.520897 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ae9822c5-df38-4530-b4c8-2e5319300d76 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:54.521589 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ae9822c5-df38-4530-b4c8-2e5319300d76 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:54.522045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ae9822c5-df38-4530-b4c8-2e5319300d76 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:54.522465 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ae9822c5-df38-4530-b4c8-2e5319300d76 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:54.658756 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ae9822c5-df38-4530-b4c8-2e5319300d76 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:54.667487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ae9822c5-df38-4530-b4c8-2e5319300d76 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1733 microversion: 2.1 time: 0.158450 Aug 17 23:48:54.668078 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 393/765] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:54 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:54.983378 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-4b00eaa7-a319-48d3-a522-055b61b9d205 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:54.983995 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-4b00eaa7-a319-48d3-a522-055b61b9d205 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:54.990278 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4b00eaa7-a319-48d3-a522-055b61b9d205 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:54.990757 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4b00eaa7-a319-48d3-a522-055b61b9d205 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:54.991185 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4b00eaa7-a319-48d3-a522-055b61b9d205 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:54.991867 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4b00eaa7-a319-48d3-a522-055b61b9d205 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:54.992343 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4b00eaa7-a319-48d3-a522-055b61b9d205 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:54.992797 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4b00eaa7-a319-48d3-a522-055b61b9d205 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:55.118628 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-4b00eaa7-a319-48d3-a522-055b61b9d205 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:55.126819 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-4b00eaa7-a319-48d3-a522-055b61b9d205 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:55.128331 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-4b00eaa7-a319-48d3-a522-055b61b9d205 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:55.129507 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-4b00eaa7-a319-48d3-a522-055b61b9d205 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1795 microversion: 2.20 time: 0.150006 Aug 17 23:48:55.130081 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 373/766] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:48:54 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1795 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:48:55.688631 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9074b83a-c395-4177-9346-2af82a940989 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:55.689246 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9074b83a-c395-4177-9346-2af82a940989 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:55.695627 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9074b83a-c395-4177-9346-2af82a940989 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:55.696155 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9074b83a-c395-4177-9346-2af82a940989 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:55.696621 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9074b83a-c395-4177-9346-2af82a940989 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:55.697306 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9074b83a-c395-4177-9346-2af82a940989 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:55.697760 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9074b83a-c395-4177-9346-2af82a940989 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:55.698182 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9074b83a-c395-4177-9346-2af82a940989 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:55.827387 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9074b83a-c395-4177-9346-2af82a940989 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:55.835939 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9074b83a-c395-4177-9346-2af82a940989 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1733 microversion: 2.1 time: 0.151119 Aug 17 23:48:55.837080 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 394/767] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:55 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:56.857506 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a371730e-40a7-4927-af8e-49c1c0700962 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:56.858152 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a371730e-40a7-4927-af8e-49c1c0700962 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:56.864635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a371730e-40a7-4927-af8e-49c1c0700962 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:56.865114 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a371730e-40a7-4927-af8e-49c1c0700962 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:56.865547 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a371730e-40a7-4927-af8e-49c1c0700962 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:56.866235 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a371730e-40a7-4927-af8e-49c1c0700962 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:56.866689 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a371730e-40a7-4927-af8e-49c1c0700962 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:56.867114 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a371730e-40a7-4927-af8e-49c1c0700962 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:56.996293 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a371730e-40a7-4927-af8e-49c1c0700962 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:57.004185 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a371730e-40a7-4927-af8e-49c1c0700962 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1733 microversion: 2.1 time: 0.150489 Aug 17 23:48:57.004751 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 374/768] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:56 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:58.025689 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-3a197863-f1c4-4c78-b2ff-521eea40f896 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:58.026305 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-3a197863-f1c4-4c78-b2ff-521eea40f896 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:58.032860 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3a197863-f1c4-4c78-b2ff-521eea40f896 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:58.033397 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3a197863-f1c4-4c78-b2ff-521eea40f896 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:58.033839 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3a197863-f1c4-4c78-b2ff-521eea40f896 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:58.034524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3a197863-f1c4-4c78-b2ff-521eea40f896 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:58.034989 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3a197863-f1c4-4c78-b2ff-521eea40f896 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:58.035416 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3a197863-f1c4-4c78-b2ff-521eea40f896 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:58.168761 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-3a197863-f1c4-4c78-b2ff-521eea40f896 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:58.176684 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-3a197863-f1c4-4c78-b2ff-521eea40f896 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1733 microversion: 2.1 time: 0.155492 Aug 17 23:48:58.177240 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 395/769] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:58 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:48:59.198477 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-fd19210b-5e25-4919-b502-7d8f1b71a6e2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:48:59.199008 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-fd19210b-5e25-4919-b502-7d8f1b71a6e2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:48:59.205601 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fd19210b-5e25-4919-b502-7d8f1b71a6e2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:59.206089 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fd19210b-5e25-4919-b502-7d8f1b71a6e2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:59.206528 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fd19210b-5e25-4919-b502-7d8f1b71a6e2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:59.207223 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fd19210b-5e25-4919-b502-7d8f1b71a6e2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:48:59.207678 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fd19210b-5e25-4919-b502-7d8f1b71a6e2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:48:59.208140 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fd19210b-5e25-4919-b502-7d8f1b71a6e2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:48:59.337412 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-fd19210b-5e25-4919-b502-7d8f1b71a6e2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:48:59.345383 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-fd19210b-5e25-4919-b502-7d8f1b71a6e2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1733 microversion: 2.1 time: 0.151284 Aug 17 23:48:59.345958 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 375/770] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:48:59 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:00.366371 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-45196790-1a7b-48c3-af63-302953533606 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:00.366917 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-45196790-1a7b-48c3-af63-302953533606 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:00.373733 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-45196790-1a7b-48c3-af63-302953533606 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:00.374218 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-45196790-1a7b-48c3-af63-302953533606 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:00.374657 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-45196790-1a7b-48c3-af63-302953533606 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:00.375341 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-45196790-1a7b-48c3-af63-302953533606 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:00.375797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-45196790-1a7b-48c3-af63-302953533606 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:00.376320 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-45196790-1a7b-48c3-af63-302953533606 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:00.504662 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-45196790-1a7b-48c3-af63-302953533606 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:00.506947 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:49:00.515251 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-45196790-1a7b-48c3-af63-302953533606 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1733 microversion: 2.1 time: 0.152835 Aug 17 23:49:00.515816 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 396/771] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:00 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:01.535929 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-30439892-635d-484b-bd78-b5be19154907 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:01.536813 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-30439892-635d-484b-bd78-b5be19154907 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:01.543234 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30439892-635d-484b-bd78-b5be19154907 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:01.543712 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30439892-635d-484b-bd78-b5be19154907 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:01.544178 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30439892-635d-484b-bd78-b5be19154907 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:01.544861 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30439892-635d-484b-bd78-b5be19154907 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:01.545310 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30439892-635d-484b-bd78-b5be19154907 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:01.545726 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30439892-635d-484b-bd78-b5be19154907 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:01.563095 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=100 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:49:01.670691 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-30439892-635d-484b-bd78-b5be19154907 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:01.678635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-30439892-635d-484b-bd78-b5be19154907 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1733 microversion: 2.1 time: 0.146514 Aug 17 23:49:01.679196 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 376/772] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:01 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:02.699838 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b9b5c039-5988-4acb-9f6e-e6409ad72a5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:02.700480 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b9b5c039-5988-4acb-9f6e-e6409ad72a5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:02.707795 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b9b5c039-5988-4acb-9f6e-e6409ad72a5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:02.708244 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b9b5c039-5988-4acb-9f6e-e6409ad72a5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:02.708690 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b9b5c039-5988-4acb-9f6e-e6409ad72a5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:02.709374 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b9b5c039-5988-4acb-9f6e-e6409ad72a5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:02.709830 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b9b5c039-5988-4acb-9f6e-e6409ad72a5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:02.710255 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b9b5c039-5988-4acb-9f6e-e6409ad72a5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:02.843605 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b9b5c039-5988-4acb-9f6e-e6409ad72a5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:02.852251 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b9b5c039-5988-4acb-9f6e-e6409ad72a5f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1733 microversion: 2.1 time: 0.155925 Aug 17 23:49:02.852832 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 397/773] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:02 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:03.873852 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-4e64bb28-1d9e-4594-a8c5-8302d7a66ad2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:03.874465 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-4e64bb28-1d9e-4594-a8c5-8302d7a66ad2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:03.880931 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4e64bb28-1d9e-4594-a8c5-8302d7a66ad2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:03.881420 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4e64bb28-1d9e-4594-a8c5-8302d7a66ad2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:03.881859 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4e64bb28-1d9e-4594-a8c5-8302d7a66ad2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:03.882554 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4e64bb28-1d9e-4594-a8c5-8302d7a66ad2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:03.883046 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4e64bb28-1d9e-4594-a8c5-8302d7a66ad2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:03.883470 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4e64bb28-1d9e-4594-a8c5-8302d7a66ad2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:04.011304 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-4e64bb28-1d9e-4594-a8c5-8302d7a66ad2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:04.019565 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-4e64bb28-1d9e-4594-a8c5-8302d7a66ad2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1733 microversion: 2.1 time: 0.149603 Aug 17 23:49:04.020165 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 377/774] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:03 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:05.040863 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-52b9838a-fa91-465a-abd9-58c42b2226d5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:05.041472 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-52b9838a-fa91-465a-abd9-58c42b2226d5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:05.048114 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-52b9838a-fa91-465a-abd9-58c42b2226d5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:05.048598 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-52b9838a-fa91-465a-abd9-58c42b2226d5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:05.049033 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-52b9838a-fa91-465a-abd9-58c42b2226d5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:05.049721 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-52b9838a-fa91-465a-abd9-58c42b2226d5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:05.050179 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-52b9838a-fa91-465a-abd9-58c42b2226d5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:05.050603 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-52b9838a-fa91-465a-abd9-58c42b2226d5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:05.176646 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-52b9838a-fa91-465a-abd9-58c42b2226d5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:05.184940 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-52b9838a-fa91-465a-abd9-58c42b2226d5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1733 microversion: 2.1 time: 0.148249 Aug 17 23:49:05.185497 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 398/775] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:05 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:06.206263 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f54a04b6-1500-4b6d-a6eb-6ab60de31339 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:06.206871 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f54a04b6-1500-4b6d-a6eb-6ab60de31339 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:06.213864 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f54a04b6-1500-4b6d-a6eb-6ab60de31339 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:06.214345 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f54a04b6-1500-4b6d-a6eb-6ab60de31339 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:06.214776 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f54a04b6-1500-4b6d-a6eb-6ab60de31339 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:06.215462 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f54a04b6-1500-4b6d-a6eb-6ab60de31339 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:06.215913 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f54a04b6-1500-4b6d-a6eb-6ab60de31339 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:06.216355 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f54a04b6-1500-4b6d-a6eb-6ab60de31339 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:06.345204 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f54a04b6-1500-4b6d-a6eb-6ab60de31339 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:06.353097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f54a04b6-1500-4b6d-a6eb-6ab60de31339 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1733 microversion: 2.1 time: 0.150726 Aug 17 23:49:06.353689 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 378/776] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:06 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:07.374316 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-451e1f16-e5e6-4fd2-a612-8b2c7fb0a207 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:07.374961 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-451e1f16-e5e6-4fd2-a612-8b2c7fb0a207 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:07.377206 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=40 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:49:07.382334 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-451e1f16-e5e6-4fd2-a612-8b2c7fb0a207 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:07.383487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-451e1f16-e5e6-4fd2-a612-8b2c7fb0a207 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:07.383923 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-451e1f16-e5e6-4fd2-a612-8b2c7fb0a207 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:07.384624 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-451e1f16-e5e6-4fd2-a612-8b2c7fb0a207 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:07.385075 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-451e1f16-e5e6-4fd2-a612-8b2c7fb0a207 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:07.385493 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-451e1f16-e5e6-4fd2-a612-8b2c7fb0a207 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:07.519734 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-451e1f16-e5e6-4fd2-a612-8b2c7fb0a207 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:07.527687 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-451e1f16-e5e6-4fd2-a612-8b2c7fb0a207 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1713 microversion: 2.1 time: 0.157360 Aug 17 23:49:07.528302 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 399/777] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:07 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1713 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:07.588379 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-526b487b-ae3c-492f-a63f-a3113890622e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:07.588907 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-526b487b-ae3c-492f-a63f-a3113890622e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:07.595264 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-526b487b-ae3c-492f-a63f-a3113890622e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:07.595752 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-526b487b-ae3c-492f-a63f-a3113890622e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:07.596223 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-526b487b-ae3c-492f-a63f-a3113890622e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:07.596921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-526b487b-ae3c-492f-a63f-a3113890622e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:07.597379 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-526b487b-ae3c-492f-a63f-a3113890622e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:07.597805 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-526b487b-ae3c-492f-a63f-a3113890622e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:07.718776 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-526b487b-ae3c-492f-a63f-a3113890622e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] HTTP exception thrown: Cannot 'detach_volume' instance 20b73d6d-ce40-4adb-bbd2-7ac326eb758a while it is in vm_state rescued Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-526b487b-ae3c-492f-a63f-a3113890622e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Request method failure captured: Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: DELETE /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/os-volume_attachments/29ec83ec-a285-443e-a8f3-92c83d6628a4 HTTP/1.1 Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X0diO02GDVsees0ow7IkXKzIuul6QEmJ2Nv7i9HfBPD7e2j-jzLKTFcjJ8KBABEjBcsMQiTuyNcmjGYaRHOtX6NetLnvMesRTx1pmEyyYO3llMGBjIGxbDgoTaetHgZcL5KAnV1LdBDF1RGbkUDkZ3WWB_pyjiCJNMMeOwgFJjlQuk Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: dbc0fe79b67f4446b1a4c36c068f9b00 Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1988082284 Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:49:07.720421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:49:07.722117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dbc0fe79b67f4446b1a4c36c068f9b00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dbc0fe79b67f4446b1a4c36c068f9b00", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dbc0fe79b67f4446b1a4c36c068f9b00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dbc0fe79b67f4446b1a4c36c068f9b00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:49:07.722117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1988082284 Aug 17 23:49:07.722117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: dbc0fe79b67f4446b1a4c36c068f9b00 Aug 17 23:49:07.722117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1988082284 Aug 17 23:49:07.722117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-ServerRescueNegativeTestJSON-1988082284-project Aug 17 23:49:07.722117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:49:07.722117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:49:07.722117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: c67dec924b7e4f0aa0874e6e21879889 Aug 17 23:49:07.722117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1988082284-project Aug 17 23:49:07.722117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:49:07.722117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Cannot 'detach_volume' instance 20b73d6d-ce40-4adb-bbd2-7ac326eb758a while it is in vm_state rescued Aug 17 23:49:07.722943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'server_id': '20b73d6d-ce40-4adb-bbd2-7ac326eb758a', 'id': '29ec83ec-a285-443e-a8f3-92c83d6628a4'} Aug 17 23:49:07.722943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:49:07.722943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:49:07.722943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 17 23:49:07.722943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 17 23:49:07.722943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 23:49:07.722943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 23:49:07.722943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 17 23:49:07.722943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 17 23:49:07.722943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 20b73d6d-ce40-4adb-bbd2-7ac326eb758a in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 17 23:49:07.722943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:49:07.722943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:49:07.722943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:49:07.722943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:49:07.722943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:49:07.722943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:49:07.722943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:49:07.722943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:49:07.722943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:49:07.722943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:49:07.724524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 17 23:49:07.724524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 17 23:49:07.724524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 17 23:49:07.724524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 17 23:49:07.724524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 20b73d6d-ce40-4adb-bbd2-7ac326eb758a while it is in vm_state rescued Aug 17 23:49:07.724524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:49:07.724524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:49:07.724524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:49:07.724524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:49:07.724524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:49:07.724524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:49:07.724524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:49:07.724524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:49:07.724524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 20b73d6d-ce40-4adb-bbd2-7ac326eb758a while it is in vm_state rescued Aug 17 23:49:07.724524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:49:07.724524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-526b487b-ae3c-492f-a63f-a3113890622e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Returning 409 to user: Cannot 'detach_volume' instance 20b73d6d-ce40-4adb-bbd2-7ac326eb758a while it is in vm_state rescued {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:49:07.725709 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-526b487b-ae3c-492f-a63f-a3113890622e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "DELETE /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/os-volume_attachments/29ec83ec-a285-443e-a8f3-92c83d6628a4" status: 409 len: 152 microversion: 2.1 time: 0.137508 Aug 17 23:49:07.725709 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 379/778] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 17 23:49:07 2022] DELETE /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/os-volume_attachments/29ec83ec-a285-443e-a8f3-92c83d6628a4 => generated 152 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 17 23:49:07.731218 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b4e836c5-d6cd-4337-835e-0ad7b2f6a3c2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:49:07.731752 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b4e836c5-d6cd-4337-835e-0ad7b2f6a3c2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:07.737628 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b4e836c5-d6cd-4337-835e-0ad7b2f6a3c2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:07.738112 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b4e836c5-d6cd-4337-835e-0ad7b2f6a3c2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:07.738550 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b4e836c5-d6cd-4337-835e-0ad7b2f6a3c2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:07.739231 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b4e836c5-d6cd-4337-835e-0ad7b2f6a3c2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:07.739689 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b4e836c5-d6cd-4337-835e-0ad7b2f6a3c2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:07.740139 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b4e836c5-d6cd-4337-835e-0ad7b2f6a3c2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:07.803516 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b4e836c5-d6cd-4337-835e-0ad7b2f6a3c2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "POST /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/action" status: 202 len: 0 microversion: 2.1 time: 0.075902 Aug 17 23:49:07.804166 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 400/779] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 17 23:49:07 2022] POST /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:49:07.813531 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f9e8569c-7b5e-4448-b05a-0669f11d269f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:07.814237 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f9e8569c-7b5e-4448-b05a-0669f11d269f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:07.820935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f9e8569c-7b5e-4448-b05a-0669f11d269f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:07.821420 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f9e8569c-7b5e-4448-b05a-0669f11d269f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:07.821896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f9e8569c-7b5e-4448-b05a-0669f11d269f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:07.822619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f9e8569c-7b5e-4448-b05a-0669f11d269f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:07.823214 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f9e8569c-7b5e-4448-b05a-0669f11d269f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:07.823709 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f9e8569c-7b5e-4448-b05a-0669f11d269f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:08.005209 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f9e8569c-7b5e-4448-b05a-0669f11d269f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:08.013342 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f9e8569c-7b5e-4448-b05a-0669f11d269f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1721 microversion: 2.1 time: 0.204210 Aug 17 23:49:08.013913 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 380/780] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:07 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:09.036065 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-98174396-3b67-41dd-8429-e934e55af047 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:09.037016 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-98174396-3b67-41dd-8429-e934e55af047 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:09.043095 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-98174396-3b67-41dd-8429-e934e55af047 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:09.043579 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-98174396-3b67-41dd-8429-e934e55af047 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:09.044036 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-98174396-3b67-41dd-8429-e934e55af047 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:09.044725 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-98174396-3b67-41dd-8429-e934e55af047 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:09.045178 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-98174396-3b67-41dd-8429-e934e55af047 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:09.045602 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-98174396-3b67-41dd-8429-e934e55af047 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:09.172917 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-98174396-3b67-41dd-8429-e934e55af047 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:09.181205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-98174396-3b67-41dd-8429-e934e55af047 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1721 microversion: 2.1 time: 0.150275 Aug 17 23:49:09.181758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 401/781] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:09 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:10.201860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a645548a-90b1-4369-8698-b03cf384aacc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:10.202475 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a645548a-90b1-4369-8698-b03cf384aacc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:10.208897 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a645548a-90b1-4369-8698-b03cf384aacc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:10.209378 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a645548a-90b1-4369-8698-b03cf384aacc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:10.209816 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a645548a-90b1-4369-8698-b03cf384aacc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:10.210505 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a645548a-90b1-4369-8698-b03cf384aacc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:10.211472 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a645548a-90b1-4369-8698-b03cf384aacc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:10.211894 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a645548a-90b1-4369-8698-b03cf384aacc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:10.340769 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a645548a-90b1-4369-8698-b03cf384aacc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:10.348661 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a645548a-90b1-4369-8698-b03cf384aacc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1721 microversion: 2.1 time: 0.150674 Aug 17 23:49:10.349216 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 381/782] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:10 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:11.369516 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-5eb5a20e-eec7-446c-ba63-c11ab76d7b74 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:11.370129 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-5eb5a20e-eec7-446c-ba63-c11ab76d7b74 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:11.376518 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5eb5a20e-eec7-446c-ba63-c11ab76d7b74 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:11.377034 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5eb5a20e-eec7-446c-ba63-c11ab76d7b74 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:11.377472 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5eb5a20e-eec7-446c-ba63-c11ab76d7b74 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:11.378159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5eb5a20e-eec7-446c-ba63-c11ab76d7b74 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:11.378620 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5eb5a20e-eec7-446c-ba63-c11ab76d7b74 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:11.379045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5eb5a20e-eec7-446c-ba63-c11ab76d7b74 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:11.508448 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5eb5a20e-eec7-446c-ba63-c11ab76d7b74 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:11.516343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-5eb5a20e-eec7-446c-ba63-c11ab76d7b74 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1721 microversion: 2.1 time: 0.150690 Aug 17 23:49:11.516904 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 402/783] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:11 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:12.538451 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-df1739eb-11ee-47a4-8a64-923e7bcba939 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:12.539689 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-df1739eb-11ee-47a4-8a64-923e7bcba939 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:12.546112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-df1739eb-11ee-47a4-8a64-923e7bcba939 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:12.546593 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-df1739eb-11ee-47a4-8a64-923e7bcba939 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:12.547030 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-df1739eb-11ee-47a4-8a64-923e7bcba939 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:12.547726 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-df1739eb-11ee-47a4-8a64-923e7bcba939 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:12.548206 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-df1739eb-11ee-47a4-8a64-923e7bcba939 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:12.548629 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-df1739eb-11ee-47a4-8a64-923e7bcba939 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:12.682201 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-df1739eb-11ee-47a4-8a64-923e7bcba939 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:12.690054 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-df1739eb-11ee-47a4-8a64-923e7bcba939 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1727 microversion: 2.1 time: 0.155729 Aug 17 23:49:12.690660 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 382/784] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:12 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:12.711418 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-cb7d9076-59b1-489e-b295-628c1d2eb4df tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:12.711914 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-cb7d9076-59b1-489e-b295-628c1d2eb4df tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:12.718378 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cb7d9076-59b1-489e-b295-628c1d2eb4df tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:12.718864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cb7d9076-59b1-489e-b295-628c1d2eb4df tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:12.719307 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cb7d9076-59b1-489e-b295-628c1d2eb4df tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:12.720019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cb7d9076-59b1-489e-b295-628c1d2eb4df tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:12.720479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cb7d9076-59b1-489e-b295-628c1d2eb4df tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:12.720909 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cb7d9076-59b1-489e-b295-628c1d2eb4df tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:12.796669 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-cb7d9076-59b1-489e-b295-628c1d2eb4df tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089679 Aug 17 23:49:12.797257 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 403/785] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Aug 17 23:49:12 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:49:13.722869 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-b7780edb-30eb-4786-9b99-812d9696feb2 req-e10bc176-24e6-4abe-b286-167d78cdd04e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b73d6d-ce40-4adb-bbd2-7ac326eb758a", "tag": "a7bb89fa-fcc0-415d-8ac1-70d1ad224517"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:49:13.732923 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-b7780edb-30eb-4786-9b99-812d9696feb2 req-e10bc176-24e6-4abe-b286-167d78cdd04e service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:13.733407 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-b7780edb-30eb-4786-9b99-812d9696feb2 req-e10bc176-24e6-4abe-b286-167d78cdd04e service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:13.733839 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-b7780edb-30eb-4786-9b99-812d9696feb2 req-e10bc176-24e6-4abe-b286-167d78cdd04e service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:13.745053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-b7780edb-30eb-4786-9b99-812d9696feb2 req-e10bc176-24e6-4abe-b286-167d78cdd04e service nova] Creating event network-changed:a7bb89fa-fcc0-415d-8ac1-70d1ad224517 for instance 20b73d6d-ce40-4adb-bbd2-7ac326eb758a on hv-cinder-82002 Aug 17 23:49:13.750054 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-b7780edb-30eb-4786-9b99-812d9696feb2 req-e10bc176-24e6-4abe-b286-167d78cdd04e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089213 Aug 17 23:49:13.750641 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 383/786] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:49:15.764775 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-833f5636-0717-427e-8a1e-bb577c200d80 req-fb23a3a6-bc49-4ce0-86ed-56ad8ee90077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b73d6d-ce40-4adb-bbd2-7ac326eb758a", "tag": "a7bb89fa-fcc0-415d-8ac1-70d1ad224517"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:49:15.774653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-833f5636-0717-427e-8a1e-bb577c200d80 req-fb23a3a6-bc49-4ce0-86ed-56ad8ee90077 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:15.775125 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-833f5636-0717-427e-8a1e-bb577c200d80 req-fb23a3a6-bc49-4ce0-86ed-56ad8ee90077 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:15.775550 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-833f5636-0717-427e-8a1e-bb577c200d80 req-fb23a3a6-bc49-4ce0-86ed-56ad8ee90077 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:15.786226 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-833f5636-0717-427e-8a1e-bb577c200d80 req-fb23a3a6-bc49-4ce0-86ed-56ad8ee90077 service nova] Creating event network-changed:a7bb89fa-fcc0-415d-8ac1-70d1ad224517 for instance 20b73d6d-ce40-4adb-bbd2-7ac326eb758a on hv-cinder-82002 Aug 17 23:49:15.791312 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-833f5636-0717-427e-8a1e-bb577c200d80 req-fb23a3a6-bc49-4ce0-86ed-56ad8ee90077 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030688 Aug 17 23:49:15.791882 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 404/787] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:49:37.727988 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=35 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:49:37.728778 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=40 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:49:37.782160 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b5e24703-4678-483b-b854-a1e771750187 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:37.782757 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b5e24703-4678-483b-b854-a1e771750187 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:37.789047 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b5e24703-4678-483b-b854-a1e771750187 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:37.790143 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b5e24703-4678-483b-b854-a1e771750187 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:37.790593 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b5e24703-4678-483b-b854-a1e771750187 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:37.791292 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b5e24703-4678-483b-b854-a1e771750187 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:37.791754 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b5e24703-4678-483b-b854-a1e771750187 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:37.792209 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b5e24703-4678-483b-b854-a1e771750187 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:37.814293 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b5e24703-4678-483b-b854-a1e771750187 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3/ips" status: 200 len: 150 microversion: 2.1 time: 0.088538 Aug 17 23:49:37.814842 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 384/788] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Aug 17 23:49:37 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3/ips => generated 150 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:49:37.824039 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=11 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:49:37.824959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:49:37.829525 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-df925ae2-0746-418c-9f76-342d8098ad4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c325da96-83c2-41da-a9c6-a765d32da165"}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:49:37.831928 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-df925ae2-0746-418c-9f76-342d8098ad4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:37.840427 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df925ae2-0746-418c-9f76-342d8098ad4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:37.840947 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df925ae2-0746-418c-9f76-342d8098ad4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:37.841441 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df925ae2-0746-418c-9f76-342d8098ad4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:37.842233 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df925ae2-0746-418c-9f76-342d8098ad4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:37.842715 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df925ae2-0746-418c-9f76-342d8098ad4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:37.843224 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df925ae2-0746-418c-9f76-342d8098ad4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:37.930548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-df925ae2-0746-418c-9f76-342d8098ad4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] HTTP exception thrown: Invalid volume: volume c325da96-83c2-41da-a9c6-a765d32da165 is already attached to instances: d619bf9d-15c1-4cef-bcc3-4a792878bf73 Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-df925ae2-0746-418c-9f76-342d8098ad4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Request method failure captured: Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: POST /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3/os-volume_attachments HTTP/1.1 Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 74 Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X0aZ0Ay-kH6PfvZI7cy17XlPDvVBNqULzMfSd2lBqPeFYOLCW2B4uA7eGgDIh2gyhJRiaquGwrFB0FR_dzBw5dUqMK9aTJoKgjhkCfhyQeKvg5eOtWGiYm8JdFQIhcHvXQSe7gtpzF6F2XNri6JktJopfvlHW5wMD7P-KZBPLA4s0c Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:49:37.932342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:49:37.933927 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/258851d93c2d466a85150116d68441b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_258851d93c2d466a85150116d68441b6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:49:37.933927 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:49:37.933927 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:49:37.933927 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:49:37.933927 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:49:37.933927 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:49:37.933927 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:49:37.933927 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 21e06d9bb5a240459ef3298a990a42f2 Aug 17 23:49:37.933927 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:49:37.933927 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Aug 17 23:49:37.933927 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {"volumeAttachment": {"volumeId": "c325da96-83c2-41da-a9c6-a765d32da165"}} Aug 17 23:49:37.933927 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:49:37.934869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Invalid volume: volume c325da96-83c2-41da-a9c6-a765d32da165 is already attached to instances: d619bf9d-15c1-4cef-bcc3-4a792878bf73 Aug 17 23:49:37.934869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'server_id': 'a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3', 'body': {'volumeAttachment': {'volumeId': 'c325da96-83c2-41da-a9c6-a765d32da165'}}} Aug 17 23:49:37.934869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:49:37.934869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:49:37.934869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 23:49:37.934869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 23:49:37.934869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 23:49:37.934869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 23:49:37.934869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 17 23:49:37.934869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 17 23:49:37.934869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 17 23:49:37.934869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 17 23:49:37.934869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 17 23:49:37.934869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 17 23:49:37.934869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c325da96-83c2-41da-a9c6-a765d32da165 is already attached to instances: d619bf9d-15c1-4cef-bcc3-4a792878bf73 Aug 17 23:49:37.934869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:49:37.934869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:49:37.934869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:49:37.934869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:49:37.936360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:49:37.936360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:49:37.936360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:49:37.936360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:49:37.936360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:49:37.936360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:49:37.936360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 23:49:37.936360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 23:49:37.936360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 23:49:37.936360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 23:49:37.936360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 23:49:37.936360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 23:49:37.936360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 17 23:49:37.936360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 17 23:49:37.936360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c325da96-83c2-41da-a9c6-a765d32da165 is already attached to instances: d619bf9d-15c1-4cef-bcc3-4a792878bf73 Aug 17 23:49:37.936360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:49:37.936360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:49:37.936360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:49:37.936360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:49:37.936360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:49:37.937878 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:49:37.937878 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:49:37.937878 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:49:37.937878 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c325da96-83c2-41da-a9c6-a765d32da165 is already attached to instances: d619bf9d-15c1-4cef-bcc3-4a792878bf73 Aug 17 23:49:37.937878 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:49:37.937878 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-df925ae2-0746-418c-9f76-342d8098ad4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Returning 400 to user: Invalid volume: volume c325da96-83c2-41da-a9c6-a765d32da165 is already attached to instances: d619bf9d-15c1-4cef-bcc3-4a792878bf73 {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:49:37.937878 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-df925ae2-0746-418c-9f76-342d8098ad4d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "POST /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111326 Aug 17 23:49:37.937878 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 405/789] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 17 23:49:37 2022] POST /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 23:49:37.943464 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a5d690c7-1cf3-4ea3-8bfc-338b078a3738 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:37.943954 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a5d690c7-1cf3-4ea3-8bfc-338b078a3738 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:37.949819 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a5d690c7-1cf3-4ea3-8bfc-338b078a3738 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:37.950295 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a5d690c7-1cf3-4ea3-8bfc-338b078a3738 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:37.950728 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a5d690c7-1cf3-4ea3-8bfc-338b078a3738 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:37.951405 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a5d690c7-1cf3-4ea3-8bfc-338b078a3738 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:37.951857 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a5d690c7-1cf3-4ea3-8bfc-338b078a3738 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:37.952346 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a5d690c7-1cf3-4ea3-8bfc-338b078a3738 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:37.976732 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a5d690c7-1cf3-4ea3-8bfc-338b078a3738 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Going to try to terminate instance {{(pid=131395) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:49:38.051278 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a5d690c7-1cf3-4ea3-8bfc-338b078a3738 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 204 len: 0 microversion: 2.1 time: 0.111180 Aug 17 23:49:38.052844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 385/790] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:49:37 2022] DELETE /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 23:49:38.062317 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c895104c-5765-424f-aa4e-0e15fe094a97 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:38.063044 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c895104c-5765-424f-aa4e-0e15fe094a97 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:38.069291 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c895104c-5765-424f-aa4e-0e15fe094a97 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:38.069774 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c895104c-5765-424f-aa4e-0e15fe094a97 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:38.070212 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c895104c-5765-424f-aa4e-0e15fe094a97 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:38.070895 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c895104c-5765-424f-aa4e-0e15fe094a97 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:38.071353 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c895104c-5765-424f-aa4e-0e15fe094a97 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:38.071778 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c895104c-5765-424f-aa4e-0e15fe094a97 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:38.201376 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c895104c-5765-424f-aa4e-0e15fe094a97 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:38.208933 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c895104c-5765-424f-aa4e-0e15fe094a97 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1680 microversion: 2.1 time: 0.151009 Aug 17 23:49:38.209495 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 406/791] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:38 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:39.233971 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-bbaee820-8560-4188-b0e1-8e84f7c24689 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:39.234672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-bbaee820-8560-4188-b0e1-8e84f7c24689 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:39.241111 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bbaee820-8560-4188-b0e1-8e84f7c24689 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:39.241591 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bbaee820-8560-4188-b0e1-8e84f7c24689 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:39.242026 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bbaee820-8560-4188-b0e1-8e84f7c24689 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:39.243318 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bbaee820-8560-4188-b0e1-8e84f7c24689 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:39.243775 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bbaee820-8560-4188-b0e1-8e84f7c24689 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:39.244211 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bbaee820-8560-4188-b0e1-8e84f7c24689 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:39.375316 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-bbaee820-8560-4188-b0e1-8e84f7c24689 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:39.382706 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-bbaee820-8560-4188-b0e1-8e84f7c24689 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1680 microversion: 2.1 time: 0.152978 Aug 17 23:49:39.383313 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 386/792] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:39 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:40.404069 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9ecaa06a-297c-435e-aece-f60de2449f41 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:40.404681 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9ecaa06a-297c-435e-aece-f60de2449f41 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:40.410996 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9ecaa06a-297c-435e-aece-f60de2449f41 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:40.411476 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9ecaa06a-297c-435e-aece-f60de2449f41 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:40.412202 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9ecaa06a-297c-435e-aece-f60de2449f41 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:40.412887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9ecaa06a-297c-435e-aece-f60de2449f41 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:40.413344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9ecaa06a-297c-435e-aece-f60de2449f41 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:40.413764 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9ecaa06a-297c-435e-aece-f60de2449f41 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:40.759280 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9ecaa06a-297c-435e-aece-f60de2449f41 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:40.766938 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9ecaa06a-297c-435e-aece-f60de2449f41 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1680 microversion: 2.1 time: 0.366690 Aug 17 23:49:40.767844 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 407/793] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:40 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1680 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:41.266417 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-01c6a151-e1be-4842-9b9d-9777f38ff9d7 req-59093742-076a-477a-91bd-a5d91fbdfba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3", "name": "network-vif-deleted", "tag": "dfa9d9dc-5ba7-401c-ba5e-15d6312bb95f"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:49:41.276453 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-01c6a151-e1be-4842-9b9d-9777f38ff9d7 req-59093742-076a-477a-91bd-a5d91fbdfba8 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:41.277137 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-01c6a151-e1be-4842-9b9d-9777f38ff9d7 req-59093742-076a-477a-91bd-a5d91fbdfba8 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:41.277742 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-01c6a151-e1be-4842-9b9d-9777f38ff9d7 req-59093742-076a-477a-91bd-a5d91fbdfba8 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:41.289241 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-01c6a151-e1be-4842-9b9d-9777f38ff9d7 req-59093742-076a-477a-91bd-a5d91fbdfba8 service nova] Creating event network-vif-deleted:dfa9d9dc-5ba7-401c-ba5e-15d6312bb95f for instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 on hv-cinder-82002 Aug 17 23:49:41.294401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-01c6a151-e1be-4842-9b9d-9777f38ff9d7 req-59093742-076a-477a-91bd-a5d91fbdfba8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094378 Aug 17 23:49:41.295265 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 387/794] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:49:41.602376 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ad292ee2-fea4-4525-852c-f4e457a9c93d tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:49:41.605314 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ad292ee2-fea4-4525-852c-f4e457a9c93d tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:41.612061 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ad292ee2-fea4-4525-852c-f4e457a9c93d tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:41.612614 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ad292ee2-fea4-4525-852c-f4e457a9c93d tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:41.613229 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ad292ee2-fea4-4525-852c-f4e457a9c93d tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:41.613942 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ad292ee2-fea4-4525-852c-f4e457a9c93d tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:41.614428 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ad292ee2-fea4-4525-852c-f4e457a9c93d tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:41.614880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ad292ee2-fea4-4525-852c-f4e457a9c93d tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:41.693102 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ad292ee2-fea4-4525-852c-f4e457a9c93d tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "POST /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017/action" status: 202 len: 0 microversion: 2.1 time: 0.094423 Aug 17 23:49:41.694030 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 408/795] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 17 23:49:41 2022] POST /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:49:41.705293 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-4376b9a3-5b75-4b7f-b2fc-72d6ce0c96fe tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:41.706392 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-4376b9a3-5b75-4b7f-b2fc-72d6ce0c96fe tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:41.715552 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4376b9a3-5b75-4b7f-b2fc-72d6ce0c96fe tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:41.716548 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4376b9a3-5b75-4b7f-b2fc-72d6ce0c96fe tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:41.717473 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4376b9a3-5b75-4b7f-b2fc-72d6ce0c96fe tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:41.719101 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4376b9a3-5b75-4b7f-b2fc-72d6ce0c96fe tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:41.720021 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4376b9a3-5b75-4b7f-b2fc-72d6ce0c96fe tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:41.720674 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4376b9a3-5b75-4b7f-b2fc-72d6ce0c96fe tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:41.792342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-401be48b-ecaa-4334-99c6-33238ce0d29b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:41.793362 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-401be48b-ecaa-4334-99c6-33238ce0d29b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:41.809113 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-401be48b-ecaa-4334-99c6-33238ce0d29b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:41.809994 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-401be48b-ecaa-4334-99c6-33238ce0d29b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:41.810656 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-401be48b-ecaa-4334-99c6-33238ce0d29b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:41.811790 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-401be48b-ecaa-4334-99c6-33238ce0d29b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:41.813004 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-401be48b-ecaa-4334-99c6-33238ce0d29b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:41.814524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-401be48b-ecaa-4334-99c6-33238ce0d29b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:41.865046 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-401be48b-ecaa-4334-99c6-33238ce0d29b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:41.865948 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-401be48b-ecaa-4334-99c6-33238ce0d29b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:41.866302 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-401be48b-ecaa-4334-99c6-33238ce0d29b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:41.867015 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.objects.instance [None req-401be48b-ecaa-4334-99c6-33238ce0d29b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lazy-loading 'fault' on Instance uuid a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 {{(pid=131394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:49:41.920722 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-401be48b-ecaa-4334-99c6-33238ce0d29b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:41.934966 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-401be48b-ecaa-4334-99c6-33238ce0d29b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 200 len: 1330 microversion: 2.1 time: 0.149557 Aug 17 23:49:41.936315 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 409/796] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:41 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 1330 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:49:41.970449 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-4376b9a3-5b75-4b7f-b2fc-72d6ce0c96fe tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:41.978994 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-4376b9a3-5b75-4b7f-b2fc-72d6ce0c96fe tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1752 microversion: 2.1 time: 0.278869 Aug 17 23:49:41.979915 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 388/797] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:41 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1752 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:42.956608 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-4078b2f5-a655-4302-8e6d-af6bfafd3b19 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:42.957244 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-4078b2f5-a655-4302-8e6d-af6bfafd3b19 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:42.964388 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4078b2f5-a655-4302-8e6d-af6bfafd3b19 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:42.964880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4078b2f5-a655-4302-8e6d-af6bfafd3b19 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:42.965310 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4078b2f5-a655-4302-8e6d-af6bfafd3b19 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:42.966015 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4078b2f5-a655-4302-8e6d-af6bfafd3b19 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:42.966461 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4078b2f5-a655-4302-8e6d-af6bfafd3b19 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:42.967359 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4078b2f5-a655-4302-8e6d-af6bfafd3b19 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:42.983239 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-4078b2f5-a655-4302-8e6d-af6bfafd3b19 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] HTTP exception thrown: Instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 could not be found. Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-4078b2f5-a655-4302-8e6d-af6bfafd3b19 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Request method failure captured: Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 HTTP/1.1 Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X0aZ0Ay-kH6PfvZI7cy17XlPDvVBNqULzMfSd2lBqPeFYOLCW2B4uA7eGgDIh2gyhJRiaquGwrFB0FR_dzBw5dUqMK9aTJoKgjhkCfhyQeKvg5eOtWGiYm8JdFQIhcHvXQSe7gtpzF6F2XNri6JktJopfvlHW5wMD7P-KZBPLA4s0c Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:49:42.985152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:49:42.986809 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/258851d93c2d466a85150116d68441b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_258851d93c2d466a85150116d68441b6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:49:42.986809 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:49:42.986809 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:49:42.986809 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:49:42.986809 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:49:42.986809 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:49:42.986809 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:49:42.986809 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 21e06d9bb5a240459ef3298a990a42f2 Aug 17 23:49:42.986809 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:49:42.986809 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:49:42.986809 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 could not be found. Aug 17 23:49:42.986809 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': 'a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3'} Aug 17 23:49:42.987688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:49:42.987688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:49:42.987688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:49:42.987688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:49:42.987688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:49:42.987688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:49:42.987688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:49:42.987688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:49:42.987688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:49:42.987688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:49:42.987688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 could not be found. Aug 17 23:49:42.987688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:49:42.987688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:49:42.987688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:49:42.987688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:49:42.987688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:49:42.987688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:49:42.987688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:49:42.987688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:49:42.987688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:49:42.989253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:49:42.989253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:49:42.989253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:49:42.989253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:49:42.989253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:49:42.989253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:49:42.989253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:49:42.989253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 could not be found. Aug 17 23:49:42.989253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:49:42.989253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:49:42.989253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:49:42.989253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:49:42.989253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:49:42.989253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:49:42.989253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:49:42.989253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:49:42.989253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 could not be found. Aug 17 23:49:42.989253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:49:42.990552 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-4078b2f5-a655-4302-8e6d-af6bfafd3b19 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Returning 404 to user: Instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:49:42.990552 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-4078b2f5-a655-4302-8e6d-af6bfafd3b19 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 404 len: 111 microversion: 2.1 time: 0.033919 Aug 17 23:49:42.991081 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 410/798] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:42 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:49:42.997089 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-16ab5fca-d41a-414e-8b6d-9891cf318167 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '.version_select at 0x7f8601fc68b0>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:43.003337 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ddb19045-1115-488d-8e63-817609e7556c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:43.004090 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ddb19045-1115-488d-8e63-817609e7556c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:43.010194 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ddb19045-1115-488d-8e63-817609e7556c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:43.010774 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ddb19045-1115-488d-8e63-817609e7556c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:43.011284 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ddb19045-1115-488d-8e63-817609e7556c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:43.012125 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ddb19045-1115-488d-8e63-817609e7556c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:43.012614 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ddb19045-1115-488d-8e63-817609e7556c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:43.013114 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ddb19045-1115-488d-8e63-817609e7556c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:43.018938 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-16ab5fca-d41a-414e-8b6d-9891cf318167 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-848511599" status: 202 len: 0 microversion: 2.1 time: 0.026295 Aug 17 23:49:43.019839 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 389/799] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Aug 17 23:49:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-848511599 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:49:43.240892 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ddb19045-1115-488d-8e63-817609e7556c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:43.254888 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ddb19045-1115-488d-8e63-817609e7556c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1757 microversion: 2.1 time: 0.255989 Aug 17 23:49:43.255683 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 411/800] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:42 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1757 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:43.783681 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-82bdcd5c-22ed-4533-b9d9-df9becf96044 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:43.784203 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-82bdcd5c-22ed-4533-b9d9-df9becf96044 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:43.793373 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-82bdcd5c-22ed-4533-b9d9-df9becf96044 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:43.793879 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-82bdcd5c-22ed-4533-b9d9-df9becf96044 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:43.794320 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-82bdcd5c-22ed-4533-b9d9-df9becf96044 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:43.795044 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-82bdcd5c-22ed-4533-b9d9-df9becf96044 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:43.795509 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-82bdcd5c-22ed-4533-b9d9-df9becf96044 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:43.795940 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-82bdcd5c-22ed-4533-b9d9-df9becf96044 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:43.885020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.objects.instance [None req-82bdcd5c-22ed-4533-b9d9-df9becf96044 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lazy-loading 'services' on Instance uuid d619bf9d-15c1-4cef-bcc3-4a792878bf73 {{(pid=131395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:49:43.997483 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-82bdcd5c-22ed-4533-b9d9-df9becf96044 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73/os-volume_attachments/c325da96-83c2-41da-a9c6-a765d32da165" status: 202 len: 0 microversion: 2.1 time: 0.217618 Aug 17 23:49:43.999115 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 390/801] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 17 23:49:43 2022] DELETE /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73/os-volume_attachments/c325da96-83c2-41da-a9c6-a765d32da165 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:49:44.006450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9bc12933-d916-478f-a83f-09e306b15855 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:44.009372 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9bc12933-d916-478f-a83f-09e306b15855 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:44.016505 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9bc12933-d916-478f-a83f-09e306b15855 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:44.016995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9bc12933-d916-478f-a83f-09e306b15855 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:44.017436 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9bc12933-d916-478f-a83f-09e306b15855 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:44.018390 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9bc12933-d916-478f-a83f-09e306b15855 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:44.018866 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9bc12933-d916-478f-a83f-09e306b15855 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:44.019292 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9bc12933-d916-478f-a83f-09e306b15855 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:44.048686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9bc12933-d916-478f-a83f-09e306b15855 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046220 Aug 17 23:49:44.049281 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 412/802] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:49:44 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:49:44.278309 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3fd47816-85a1-4448-ab45-ae0882794878 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:44.279004 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3fd47816-85a1-4448-ab45-ae0882794878 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:44.285904 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3fd47816-85a1-4448-ab45-ae0882794878 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:44.286382 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3fd47816-85a1-4448-ab45-ae0882794878 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:44.287076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3fd47816-85a1-4448-ab45-ae0882794878 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:44.287757 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3fd47816-85a1-4448-ab45-ae0882794878 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:44.288235 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3fd47816-85a1-4448-ab45-ae0882794878 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:44.288656 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3fd47816-85a1-4448-ab45-ae0882794878 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:44.435409 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3fd47816-85a1-4448-ab45-ae0882794878 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:44.443519 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3fd47816-85a1-4448-ab45-ae0882794878 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1757 microversion: 2.1 time: 0.169585 Aug 17 23:49:44.444340 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 391/803] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:44 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:45.060578 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1cfd518e-d676-4b3e-ae63-16b4fe64777d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:45.062715 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1cfd518e-d676-4b3e-ae63-16b4fe64777d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:45.069159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1cfd518e-d676-4b3e-ae63-16b4fe64777d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:45.069648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1cfd518e-d676-4b3e-ae63-16b4fe64777d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:45.070093 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1cfd518e-d676-4b3e-ae63-16b4fe64777d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:45.070789 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1cfd518e-d676-4b3e-ae63-16b4fe64777d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:45.071788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1cfd518e-d676-4b3e-ae63-16b4fe64777d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:45.072247 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1cfd518e-d676-4b3e-ae63-16b4fe64777d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:45.100967 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1cfd518e-d676-4b3e-ae63-16b4fe64777d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044307 Aug 17 23:49:45.101449 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 413/804] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:49:45 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:49:45.466435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-80443d62-b831-4507-96f6-60401678786e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:45.467048 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-80443d62-b831-4507-96f6-60401678786e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:45.473589 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-80443d62-b831-4507-96f6-60401678786e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:45.474075 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-80443d62-b831-4507-96f6-60401678786e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:45.474521 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-80443d62-b831-4507-96f6-60401678786e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:45.475197 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-80443d62-b831-4507-96f6-60401678786e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:45.475652 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-80443d62-b831-4507-96f6-60401678786e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:45.476118 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-80443d62-b831-4507-96f6-60401678786e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:45.617281 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-80443d62-b831-4507-96f6-60401678786e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:45.625667 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-80443d62-b831-4507-96f6-60401678786e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1757 microversion: 2.1 time: 0.163083 Aug 17 23:49:45.626224 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 392/805] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:45 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:46.113098 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1a78276c-e152-474b-adbe-ee61c0e5540b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:46.115385 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1a78276c-e152-474b-adbe-ee61c0e5540b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:46.121766 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1a78276c-e152-474b-adbe-ee61c0e5540b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:46.122252 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1a78276c-e152-474b-adbe-ee61c0e5540b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:46.122692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1a78276c-e152-474b-adbe-ee61c0e5540b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:46.123380 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1a78276c-e152-474b-adbe-ee61c0e5540b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:46.123836 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1a78276c-e152-474b-adbe-ee61c0e5540b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:46.124294 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1a78276c-e152-474b-adbe-ee61c0e5540b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:46.152391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1a78276c-e152-474b-adbe-ee61c0e5540b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043242 Aug 17 23:49:46.152933 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 414/806] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:49:46 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 23:49:46.212949 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a52b9f2c-7122-49fd-ae8f-57e123ff1dfa tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:46.213442 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a52b9f2c-7122-49fd-ae8f-57e123ff1dfa tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:46.219191 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a52b9f2c-7122-49fd-ae8f-57e123ff1dfa tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:46.219664 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a52b9f2c-7122-49fd-ae8f-57e123ff1dfa tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:46.220142 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a52b9f2c-7122-49fd-ae8f-57e123ff1dfa tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:46.220822 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a52b9f2c-7122-49fd-ae8f-57e123ff1dfa tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:46.221270 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a52b9f2c-7122-49fd-ae8f-57e123ff1dfa tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:46.221689 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a52b9f2c-7122-49fd-ae8f-57e123ff1dfa tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:46.246501 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a52b9f2c-7122-49fd-ae8f-57e123ff1dfa tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Going to try to terminate instance {{(pid=131395) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:49:46.328202 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a52b9f2c-7122-49fd-ae8f-57e123ff1dfa tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 204 len: 0 microversion: 2.1 time: 0.119035 Aug 17 23:49:46.328899 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 393/807] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:49:46 2022] DELETE /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 23:49:46.337938 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-26074f0c-ee95-4684-9fa2-ec2294f37493 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:46.338574 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-26074f0c-ee95-4684-9fa2-ec2294f37493 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:46.344364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26074f0c-ee95-4684-9fa2-ec2294f37493 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:46.344834 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26074f0c-ee95-4684-9fa2-ec2294f37493 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:46.345268 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26074f0c-ee95-4684-9fa2-ec2294f37493 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:46.345949 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26074f0c-ee95-4684-9fa2-ec2294f37493 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:46.346397 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26074f0c-ee95-4684-9fa2-ec2294f37493 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:46.346817 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26074f0c-ee95-4684-9fa2-ec2294f37493 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:46.475891 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-26074f0c-ee95-4684-9fa2-ec2294f37493 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:46.483587 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-26074f0c-ee95-4684-9fa2-ec2294f37493 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1683 microversion: 2.1 time: 0.150205 Aug 17 23:49:46.484153 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 415/808] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:46 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:46.647482 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-30a3ec20-51a9-4878-aa5b-e5561ed64377 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:46.648274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-30a3ec20-51a9-4878-aa5b-e5561ed64377 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:46.655249 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30a3ec20-51a9-4878-aa5b-e5561ed64377 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:46.655741 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30a3ec20-51a9-4878-aa5b-e5561ed64377 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:46.656202 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30a3ec20-51a9-4878-aa5b-e5561ed64377 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:46.656899 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30a3ec20-51a9-4878-aa5b-e5561ed64377 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:46.657353 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30a3ec20-51a9-4878-aa5b-e5561ed64377 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:46.657776 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30a3ec20-51a9-4878-aa5b-e5561ed64377 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:46.800034 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-30a3ec20-51a9-4878-aa5b-e5561ed64377 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:46.807894 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-30a3ec20-51a9-4878-aa5b-e5561ed64377 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1757 microversion: 2.1 time: 0.164582 Aug 17 23:49:46.808483 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 394/809] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:46 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:47.504651 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-4d363110-f31f-4dc3-ace1-797d4e424917 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:47.505266 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-4d363110-f31f-4dc3-ace1-797d4e424917 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:47.514778 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4d363110-f31f-4dc3-ace1-797d4e424917 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:47.515276 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4d363110-f31f-4dc3-ace1-797d4e424917 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:47.515713 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4d363110-f31f-4dc3-ace1-797d4e424917 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:47.516432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4d363110-f31f-4dc3-ace1-797d4e424917 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:47.516882 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4d363110-f31f-4dc3-ace1-797d4e424917 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:47.517306 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4d363110-f31f-4dc3-ace1-797d4e424917 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:47.650127 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-4d363110-f31f-4dc3-ace1-797d4e424917 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:47.657638 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-4d363110-f31f-4dc3-ace1-797d4e424917 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1683 microversion: 2.1 time: 0.156792 Aug 17 23:49:47.658288 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 416/810] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:47 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:47.828642 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f2318656-7d82-4d63-9593-a29c7bb97aba tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:47.829273 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f2318656-7d82-4d63-9593-a29c7bb97aba tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:47.836122 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2318656-7d82-4d63-9593-a29c7bb97aba tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:47.836626 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2318656-7d82-4d63-9593-a29c7bb97aba tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:47.837117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2318656-7d82-4d63-9593-a29c7bb97aba tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:47.837797 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2318656-7d82-4d63-9593-a29c7bb97aba tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:47.838439 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2318656-7d82-4d63-9593-a29c7bb97aba tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:47.838713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2318656-7d82-4d63-9593-a29c7bb97aba tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:48.233861 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f2318656-7d82-4d63-9593-a29c7bb97aba tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:48.241798 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f2318656-7d82-4d63-9593-a29c7bb97aba tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1757 microversion: 2.1 time: 0.417012 Aug 17 23:49:48.242633 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 395/811] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:47 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1757 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:48.649777 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-157d12e0-5fa3-4d95-83bb-557c7a8fb635 req-32fc5c4b-87f5-466e-87e1-a077485be587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d619bf9d-15c1-4cef-bcc3-4a792878bf73", "name": "network-vif-deleted", "tag": "f60e9126-8ff5-4a1e-bdee-fcf39e05162b"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:49:48.660195 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-157d12e0-5fa3-4d95-83bb-557c7a8fb635 req-32fc5c4b-87f5-466e-87e1-a077485be587 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:48.660681 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-157d12e0-5fa3-4d95-83bb-557c7a8fb635 req-32fc5c4b-87f5-466e-87e1-a077485be587 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:48.661113 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-157d12e0-5fa3-4d95-83bb-557c7a8fb635 req-32fc5c4b-87f5-466e-87e1-a077485be587 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:48.672492 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-157d12e0-5fa3-4d95-83bb-557c7a8fb635 req-32fc5c4b-87f5-466e-87e1-a077485be587 service nova] Creating event network-vif-deleted:f60e9126-8ff5-4a1e-bdee-fcf39e05162b for instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 on hv-cinder-82002 Aug 17 23:49:48.677101 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-157d12e0-5fa3-4d95-83bb-557c7a8fb635 req-32fc5c4b-87f5-466e-87e1-a077485be587 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031153 Aug 17 23:49:48.677982 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 417/812] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:49:48.683130 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-8fb4d54d-ff92-46ab-a481-c380c7e06abe tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:48.684271 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-8fb4d54d-ff92-46ab-a481-c380c7e06abe tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:48.693370 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8fb4d54d-ff92-46ab-a481-c380c7e06abe tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:48.693887 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8fb4d54d-ff92-46ab-a481-c380c7e06abe tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:48.694322 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8fb4d54d-ff92-46ab-a481-c380c7e06abe tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:48.695023 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8fb4d54d-ff92-46ab-a481-c380c7e06abe tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:48.695472 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8fb4d54d-ff92-46ab-a481-c380c7e06abe tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:48.695891 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8fb4d54d-ff92-46ab-a481-c380c7e06abe tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:48.772263 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8fb4d54d-ff92-46ab-a481-c380c7e06abe tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:48.780976 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-8fb4d54d-ff92-46ab-a481-c380c7e06abe tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 200 len: 1327 microversion: 2.1 time: 0.104032 Aug 17 23:49:48.782080 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 396/813] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:48 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:49.263331 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-37940b4e-1a44-448f-80d8-890e675e371a tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:49.264087 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-37940b4e-1a44-448f-80d8-890e675e371a tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:49.270623 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-37940b4e-1a44-448f-80d8-890e675e371a tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:49.271105 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-37940b4e-1a44-448f-80d8-890e675e371a tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:49.271743 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-37940b4e-1a44-448f-80d8-890e675e371a tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:49.272463 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-37940b4e-1a44-448f-80d8-890e675e371a tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:49.273085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-37940b4e-1a44-448f-80d8-890e675e371a tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:49.273513 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-37940b4e-1a44-448f-80d8-890e675e371a tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:49.432510 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-37940b4e-1a44-448f-80d8-890e675e371a tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:49.445192 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-37940b4e-1a44-448f-80d8-890e675e371a tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1757 microversion: 2.1 time: 0.186120 Aug 17 23:49:49.445779 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 418/814] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:49 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:49.806443 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c1441fbd-340e-4fd5-ae5e-632a0fccbd26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:49.807076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c1441fbd-340e-4fd5-ae5e-632a0fccbd26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:49.812990 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1441fbd-340e-4fd5-ae5e-632a0fccbd26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:49.813503 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1441fbd-340e-4fd5-ae5e-632a0fccbd26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:49.813941 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1441fbd-340e-4fd5-ae5e-632a0fccbd26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:49.814626 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1441fbd-340e-4fd5-ae5e-632a0fccbd26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:49.815085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1441fbd-340e-4fd5-ae5e-632a0fccbd26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:49.815538 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1441fbd-340e-4fd5-ae5e-632a0fccbd26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:49.829192 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-c1441fbd-340e-4fd5-ae5e-632a0fccbd26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] HTTP exception thrown: Instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 could not be found. Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c1441fbd-340e-4fd5-ae5e-632a0fccbd26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Request method failure captured: Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 HTTP/1.1 Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X0aZ0Ay-kH6PfvZI7cy17XlPDvVBNqULzMfSd2lBqPeFYOLCW2B4uA7eGgDIh2gyhJRiaquGwrFB0FR_dzBw5dUqMK9aTJoKgjhkCfhyQeKvg5eOtWGiYm8JdFQIhcHvXQSe7gtpzF6F2XNri6JktJopfvlHW5wMD7P-KZBPLA4s0c Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:49:49.830789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:49:49.832321 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/258851d93c2d466a85150116d68441b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_258851d93c2d466a85150116d68441b6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:49:49.832321 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:49:49.832321 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:49:49.832321 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:49:49.832321 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:49:49.832321 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:49:49.832321 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:49:49.832321 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 21e06d9bb5a240459ef3298a990a42f2 Aug 17 23:49:49.832321 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:49:49.832321 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:49:49.832321 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 could not be found. Aug 17 23:49:49.832321 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': 'd619bf9d-15c1-4cef-bcc3-4a792878bf73'} Aug 17 23:49:49.833319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:49:49.833319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:49:49.833319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:49:49.833319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:49:49.833319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:49:49.833319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:49:49.833319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:49:49.833319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:49:49.833319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:49:49.833319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:49:49.833319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 could not be found. Aug 17 23:49:49.833319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:49:49.833319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:49:49.833319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:49:49.833319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:49:49.833319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:49:49.833319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:49:49.833319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:49:49.833319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:49:49.833319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:49:49.834860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:49:49.834860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:49:49.834860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:49:49.834860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:49:49.834860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:49:49.834860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:49:49.834860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:49:49.834860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 could not be found. Aug 17 23:49:49.834860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:49:49.834860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:49:49.834860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:49:49.834860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:49:49.834860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:49:49.834860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:49:49.834860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:49:49.834860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:49:49.834860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 could not be found. Aug 17 23:49:49.834860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:49:49.836284 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c1441fbd-340e-4fd5-ae5e-632a0fccbd26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Returning 404 to user: Instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:49:49.836284 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c1441fbd-340e-4fd5-ae5e-632a0fccbd26 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 404 len: 111 microversion: 2.1 time: 0.029749 Aug 17 23:49:49.836284 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 397/815] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:49 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:49:49.841688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-2115bbc7-5a81-4cb5-8740-325a26aeb254 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '.version_select at 0x7f85fd9bb1f0>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:49.846217 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2115bbc7-5a81-4cb5-8740-325a26aeb254 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [2ff30152-f5f0-44f8-8314-20f3a896b253] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 23:49:50.465309 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0592eb7b-a0e1-451d-b450-869167122025 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:50.465920 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0592eb7b-a0e1-451d-b450-869167122025 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:50.471876 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0592eb7b-a0e1-451d-b450-869167122025 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:50.472388 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0592eb7b-a0e1-451d-b450-869167122025 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:50.472824 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0592eb7b-a0e1-451d-b450-869167122025 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:50.473505 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0592eb7b-a0e1-451d-b450-869167122025 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:50.473957 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0592eb7b-a0e1-451d-b450-869167122025 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:50.474376 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0592eb7b-a0e1-451d-b450-869167122025 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:50.619499 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0592eb7b-a0e1-451d-b450-869167122025 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:50.627374 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0592eb7b-a0e1-451d-b450-869167122025 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1757 microversion: 2.1 time: 0.165967 Aug 17 23:49:50.627936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 398/816] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:50 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:49:50.853595 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO oslo.messaging._drivers.impl_rabbit [None req-2115bbc7-5a81-4cb5-8740-325a26aeb254 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [2ff30152-f5f0-44f8-8314-20f3a896b253] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 43364. Aug 17 23:49:50.873299 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-2115bbc7-5a81-4cb5-8740-325a26aeb254 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1223893707" status: 202 len: 0 microversion: 2.1 time: 1.036041 Aug 17 23:49:50.873862 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 419/817] 10.222.0.26 () {58 vars in 1221 bytes} [Wed Aug 17 23:49:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1223893707 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:49:51.463803 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-38f23344-6be0-41d7-b354-aad0d92220e9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Action: 'create', calling method: .version_select at 0x7f8602033ca0>, body: {"keypair": {"name": "tempest-keypair-118982698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNFsRiiCxf7HYhVmSvlXNFq/0kg4ip6K6/caJ6SALE8h7v+Ht2g6gbkdOsm2Hlp7oq/t879ur9nrymarOih3ohI+LB8POukZAr7OcV/ywiviSZMH+1g3jfD7kl6TjAg7Q=="}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:49:51.479520 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-38f23344-6be0-41d7-b354-aad0d92220e9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Getting quotas for project 258851d93c2d466a85150116d68441b6. Resources: {'key_pairs'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:49:51.483383 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-38f23344-6be0-41d7-b354-aad0d92220e9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Getting quotas for user 21e06d9bb5a240459ef3298a990a42f2 and project 258851d93c2d466a85150116d68441b6. Resources: {'key_pairs'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:49:51.504331 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-38f23344-6be0-41d7-b354-aad0d92220e9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045031 Aug 17 23:49:51.504909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 399/818] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Aug 17 23:49:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:49:51.648915 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-30336176-0914-4976-9c0a-c455ecfc8ae8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:51.649540 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-30336176-0914-4976-9c0a-c455ecfc8ae8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:51.656007 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-30336176-0914-4976-9c0a-c455ecfc8ae8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:51.656580 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-30336176-0914-4976-9c0a-c455ecfc8ae8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:51.657111 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-30336176-0914-4976-9c0a-c455ecfc8ae8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:51.657881 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-30336176-0914-4976-9c0a-c455ecfc8ae8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:51.658348 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-30336176-0914-4976-9c0a-c455ecfc8ae8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:51.658774 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-30336176-0914-4976-9c0a-c455ecfc8ae8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:51.855100 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-30336176-0914-4976-9c0a-c455ecfc8ae8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:51.863865 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-30336176-0914-4976-9c0a-c455ecfc8ae8 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1757 microversion: 2.1 time: 0.218865 Aug 17 23:49:51.864557 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 420/819] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:51 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1757 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:52.697988 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-865c9eab-3239-4509-9ae5-c73eee51f137 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1013537636", "imageRef": "a3cf81e5-e973-4c08-b1da-4e8f104b52a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1116845-6414-4feb-bcc7-64852b6be391"}], "security_groups": [{"name": "tempest-securitygroup--275871390"}], "key_name": "tempest-keypair-118982698", "user_data": "}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:49:52.803323 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.network.neutron [None req-865c9eab-3239-4509-9ae5-c73eee51f137 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] validate_networks() for [('d1116845-6414-4feb-bcc7-64852b6be391', None, None, None, None, None)] {{(pid=131395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:49:52.886071 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e946d5bf-1d1a-4ecb-adc7-dd1356cc217e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:52.886681 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e946d5bf-1d1a-4ecb-adc7-dd1356cc217e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:52.893112 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e946d5bf-1d1a-4ecb-adc7-dd1356cc217e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:52.893810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e946d5bf-1d1a-4ecb-adc7-dd1356cc217e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:52.894249 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e946d5bf-1d1a-4ecb-adc7-dd1356cc217e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:52.894935 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e946d5bf-1d1a-4ecb-adc7-dd1356cc217e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:52.895388 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e946d5bf-1d1a-4ecb-adc7-dd1356cc217e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:52.895808 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e946d5bf-1d1a-4ecb-adc7-dd1356cc217e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:53.044852 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e946d5bf-1d1a-4ecb-adc7-dd1356cc217e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:53.052801 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e946d5bf-1d1a-4ecb-adc7-dd1356cc217e tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1757 microversion: 2.1 time: 0.171130 Aug 17 23:49:53.053359 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 421/820] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:52 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:49:53.211047 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-865c9eab-3239-4509-9ae5-c73eee51f137 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Flavor limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:49:53.211470 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-865c9eab-3239-4509-9ae5-c73eee51f137 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Image limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:49:53.211941 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-865c9eab-3239-4509-9ae5-c73eee51f137 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Flavor pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:49:53.212447 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-865c9eab-3239-4509-9ae5-c73eee51f137 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Image pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:49:53.212864 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-865c9eab-3239-4509-9ae5-c73eee51f137 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:49:53.221474 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-865c9eab-3239-4509-9ae5-c73eee51f137 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:53.221947 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-865c9eab-3239-4509-9ae5-c73eee51f137 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:53.222380 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-865c9eab-3239-4509-9ae5-c73eee51f137 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:53.223094 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-865c9eab-3239-4509-9ae5-c73eee51f137 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:53.223543 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-865c9eab-3239-4509-9ae5-c73eee51f137 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:53.223984 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-865c9eab-3239-4509-9ae5-c73eee51f137 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:53.230695 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:49:53.244379 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-865c9eab-3239-4509-9ae5-c73eee51f137 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Getting quotas for project 258851d93c2d466a85150116d68441b6. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:49:53.248287 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-865c9eab-3239-4509-9ae5-c73eee51f137 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Getting quotas for user 21e06d9bb5a240459ef3298a990a42f2 and project 258851d93c2d466a85150116d68441b6. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:49:53.258988 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-865c9eab-3239-4509-9ae5-c73eee51f137 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Going to run 1 instances... {{(pid=131395) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:49:53.261863 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-865c9eab-3239-4509-9ae5-c73eee51f137 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a3cf81e5-e973-4c08-b1da-4e8f104b52a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:49:53.306783 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-865c9eab-3239-4509-9ae5-c73eee51f137 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.613201 Aug 17 23:49:53.307424 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 400/821] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 17 23:49:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 23:49:53.317921 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-12e5bb54-1fad-4307-b237-a2eb50d8b314 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:53.318529 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-12e5bb54-1fad-4307-b237-a2eb50d8b314 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:53.370151 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-12e5bb54-1fad-4307-b237-a2eb50d8b314 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:53.376644 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-12e5bb54-1fad-4307-b237-a2eb50d8b314 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1241 microversion: 2.1 time: 0.062398 Aug 17 23:49:53.377207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 422/822] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:53 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1241 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:54.075580 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-7f6b7391-3154-4b68-bf0f-6ee13e6e976c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:54.076261 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-7f6b7391-3154-4b68-bf0f-6ee13e6e976c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:54.082297 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7f6b7391-3154-4b68-bf0f-6ee13e6e976c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:54.082778 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7f6b7391-3154-4b68-bf0f-6ee13e6e976c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:54.083213 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7f6b7391-3154-4b68-bf0f-6ee13e6e976c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:54.083899 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7f6b7391-3154-4b68-bf0f-6ee13e6e976c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:54.084447 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7f6b7391-3154-4b68-bf0f-6ee13e6e976c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:54.084868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7f6b7391-3154-4b68-bf0f-6ee13e6e976c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:54.225539 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7f6b7391-3154-4b68-bf0f-6ee13e6e976c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:54.233458 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-7f6b7391-3154-4b68-bf0f-6ee13e6e976c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1760 microversion: 2.1 time: 0.162868 Aug 17 23:49:54.234017 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 401/823] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:54 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1760 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:54.397444 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-41580bb7-2f5b-4454-8535-6e17d7c2b63d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:54.398047 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-41580bb7-2f5b-4454-8535-6e17d7c2b63d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:54.451547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-41580bb7-2f5b-4454-8535-6e17d7c2b63d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:54.459333 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-41580bb7-2f5b-4454-8535-6e17d7c2b63d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1241 microversion: 2.1 time: 0.065604 Aug 17 23:49:54.459887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 423/824] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:54 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:55.479908 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e3b5891a-65b3-4e6f-8e00-45d37a7a3af8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:55.481164 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e3b5891a-65b3-4e6f-8e00-45d37a7a3af8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:55.536458 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e3b5891a-65b3-4e6f-8e00-45d37a7a3af8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:55.543458 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e3b5891a-65b3-4e6f-8e00-45d37a7a3af8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1241 microversion: 2.1 time: 0.067392 Aug 17 23:49:55.544126 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 402/825] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:55 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:56.564709 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-af0c1eee-49e3-419b-8957-a1b123681b7c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:56.565318 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-af0c1eee-49e3-419b-8957-a1b123681b7c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:56.620341 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-af0c1eee-49e3-419b-8957-a1b123681b7c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:56.627098 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-af0c1eee-49e3-419b-8957-a1b123681b7c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1241 microversion: 2.1 time: 0.066196 Aug 17 23:49:56.627782 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 424/826] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:56 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:56.990434 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9d268b6e-8861-4388-ac38-5f520d634f9e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:56.990960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9d268b6e-8861-4388-ac38-5f520d634f9e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:56.997975 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9d268b6e-8861-4388-ac38-5f520d634f9e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:56.998471 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9d268b6e-8861-4388-ac38-5f520d634f9e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:56.998912 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9d268b6e-8861-4388-ac38-5f520d634f9e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:56.999608 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9d268b6e-8861-4388-ac38-5f520d634f9e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:57.000096 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9d268b6e-8861-4388-ac38-5f520d634f9e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:57.000529 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9d268b6e-8861-4388-ac38-5f520d634f9e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:57.079451 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.objects.instance [None req-9d268b6e-8861-4388-ac38-5f520d634f9e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lazy-loading 'services' on Instance uuid 16b92554-3f2a-482c-bcf5-1f5f05631227 {{(pid=131395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:49:57.151046 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9d268b6e-8861-4388-ac38-5f520d634f9e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "DELETE /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227/os-volume_attachments/7bb9a702-c4f2-43d9-8dc3-a35992db7689" status: 202 len: 0 microversion: 2.1 time: 0.164440 Aug 17 23:49:57.151788 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 403/827] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 17 23:49:56 2022] DELETE /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227/os-volume_attachments/7bb9a702-c4f2-43d9-8dc3-a35992db7689 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:49:57.648364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-7bd1a295-cea8-450a-8232-b98c9cace3be tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:57.648937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-7bd1a295-cea8-450a-8232-b98c9cace3be tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:57.655834 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7bd1a295-cea8-450a-8232-b98c9cace3be tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:57.656351 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7bd1a295-cea8-450a-8232-b98c9cace3be tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:57.656789 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7bd1a295-cea8-450a-8232-b98c9cace3be tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:57.657481 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7bd1a295-cea8-450a-8232-b98c9cace3be tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:57.657934 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7bd1a295-cea8-450a-8232-b98c9cace3be tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:57.658388 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7bd1a295-cea8-450a-8232-b98c9cace3be tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:57.676998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:49:57.720694 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-7bd1a295-cea8-450a-8232-b98c9cace3be tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:57.728198 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-7bd1a295-cea8-450a-8232-b98c9cace3be tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1245 microversion: 2.1 time: 0.083775 Aug 17 23:49:57.728753 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 425/828] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:57 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:58.274967 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b4e024cb-7de0-4150-b039-435c18db0f42 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:49:58.281648 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b4e024cb-7de0-4150-b039-435c18db0f42 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:58.282125 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b4e024cb-7de0-4150-b039-435c18db0f42 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:58.282557 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b4e024cb-7de0-4150-b039-435c18db0f42 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:58.304104 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b4e024cb-7de0-4150-b039-435c18db0f42 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Going to try to stop instance {{(pid=131395) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 17 23:49:58.345201 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b4e024cb-7de0-4150-b039-435c18db0f42 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "POST /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227/action" status: 202 len: 0 microversion: 2.1 time: 0.074240 Aug 17 23:49:58.345796 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 404/829] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 17 23:49:58 2022] POST /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:49:58.353918 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-08e3bd33-5e81-4373-8e7a-3026bd34607c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:58.355209 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-08e3bd33-5e81-4373-8e7a-3026bd34607c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:58.361282 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08e3bd33-5e81-4373-8e7a-3026bd34607c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:58.361766 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08e3bd33-5e81-4373-8e7a-3026bd34607c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:58.362208 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08e3bd33-5e81-4373-8e7a-3026bd34607c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:58.362896 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08e3bd33-5e81-4373-8e7a-3026bd34607c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:58.363351 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08e3bd33-5e81-4373-8e7a-3026bd34607c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:58.363773 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08e3bd33-5e81-4373-8e7a-3026bd34607c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:58.505209 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-08e3bd33-5e81-4373-8e7a-3026bd34607c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:58.513051 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-08e3bd33-5e81-4373-8e7a-3026bd34607c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1676 microversion: 2.1 time: 0.162853 Aug 17 23:49:58.513639 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 426/830] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:58 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:58.750138 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-77ab9fca-dc46-4118-875b-f8466ec5a9e1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:58.750874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-77ab9fca-dc46-4118-875b-f8466ec5a9e1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:58.757328 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-77ab9fca-dc46-4118-875b-f8466ec5a9e1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:58.757820 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-77ab9fca-dc46-4118-875b-f8466ec5a9e1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:58.758262 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-77ab9fca-dc46-4118-875b-f8466ec5a9e1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:58.758963 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-77ab9fca-dc46-4118-875b-f8466ec5a9e1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:58.759421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-77ab9fca-dc46-4118-875b-f8466ec5a9e1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:58.759855 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-77ab9fca-dc46-4118-875b-f8466ec5a9e1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:58.863883 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-77ab9fca-dc46-4118-875b-f8466ec5a9e1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:58.871392 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-77ab9fca-dc46-4118-875b-f8466ec5a9e1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1301 microversion: 2.1 time: 0.125525 Aug 17 23:49:58.871955 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 405/831] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:58 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1301 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:59.534801 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-5f82d0d7-8912-40dd-8d1b-c1179426b957 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:59.535463 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-5f82d0d7-8912-40dd-8d1b-c1179426b957 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:59.543040 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5f82d0d7-8912-40dd-8d1b-c1179426b957 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:59.543526 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5f82d0d7-8912-40dd-8d1b-c1179426b957 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:59.543987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5f82d0d7-8912-40dd-8d1b-c1179426b957 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:59.544681 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5f82d0d7-8912-40dd-8d1b-c1179426b957 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:59.545140 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5f82d0d7-8912-40dd-8d1b-c1179426b957 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:59.545589 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5f82d0d7-8912-40dd-8d1b-c1179426b957 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:59.697539 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5f82d0d7-8912-40dd-8d1b-c1179426b957 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:49:59.721786 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-5f82d0d7-8912-40dd-8d1b-c1179426b957 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1676 microversion: 2.1 time: 0.190849 Aug 17 23:49:59.722528 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 427/832] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:59 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1676 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:49:59.893212 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-69cbe04b-08f9-4cf3-bd23-113987d3c297 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:49:59.893778 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-69cbe04b-08f9-4cf3-bd23-113987d3c297 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:49:59.901033 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-69cbe04b-08f9-4cf3-bd23-113987d3c297 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:59.902051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-69cbe04b-08f9-4cf3-bd23-113987d3c297 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:59.902483 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-69cbe04b-08f9-4cf3-bd23-113987d3c297 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:49:59.903393 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-69cbe04b-08f9-4cf3-bd23-113987d3c297 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:49:59.903902 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-69cbe04b-08f9-4cf3-bd23-113987d3c297 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:49:59.904355 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-69cbe04b-08f9-4cf3-bd23-113987d3c297 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:00.129224 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-69cbe04b-08f9-4cf3-bd23-113987d3c297 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:00.137705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-69cbe04b-08f9-4cf3-bd23-113987d3c297 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1366 microversion: 2.1 time: 0.248526 Aug 17 23:50:00.138581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 406/833] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:49:59 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:00.259570 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-303248e3-c56d-4b7e-aa32-b843768aa2e4 req-a09fc169-9fdb-48d8-ad72-c72b9bb0b17b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c039ab07-eda9-4a13-8fd1-faee03623668", "tag": "e29cf50e-a8ec-4776-a56a-132e50191ca7"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:50:00.270695 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-303248e3-c56d-4b7e-aa32-b843768aa2e4 req-a09fc169-9fdb-48d8-ad72-c72b9bb0b17b service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:00.271173 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-303248e3-c56d-4b7e-aa32-b843768aa2e4 req-a09fc169-9fdb-48d8-ad72-c72b9bb0b17b service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:00.271599 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-303248e3-c56d-4b7e-aa32-b843768aa2e4 req-a09fc169-9fdb-48d8-ad72-c72b9bb0b17b service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:00.283535 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-303248e3-c56d-4b7e-aa32-b843768aa2e4 req-a09fc169-9fdb-48d8-ad72-c72b9bb0b17b service nova] Creating event network-changed:e29cf50e-a8ec-4776-a56a-132e50191ca7 for instance c039ab07-eda9-4a13-8fd1-faee03623668 on hv-cinder-82002 Aug 17 23:50:00.289821 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-303248e3-c56d-4b7e-aa32-b843768aa2e4 req-a09fc169-9fdb-48d8-ad72-c72b9bb0b17b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033691 Aug 17 23:50:00.290600 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 428/834] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:00.744010 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-dd40a803-6625-43c9-a078-0e1c9e75f56d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:00.744632 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-dd40a803-6625-43c9-a078-0e1c9e75f56d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:00.750957 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dd40a803-6625-43c9-a078-0e1c9e75f56d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:00.751439 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dd40a803-6625-43c9-a078-0e1c9e75f56d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:00.751880 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dd40a803-6625-43c9-a078-0e1c9e75f56d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:00.752627 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dd40a803-6625-43c9-a078-0e1c9e75f56d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:00.753082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dd40a803-6625-43c9-a078-0e1c9e75f56d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:00.753508 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-dd40a803-6625-43c9-a078-0e1c9e75f56d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:00.882001 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-dd40a803-6625-43c9-a078-0e1c9e75f56d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:00.890036 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-dd40a803-6625-43c9-a078-0e1c9e75f56d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1676 microversion: 2.1 time: 0.149927 Aug 17 23:50:00.890603 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 407/835] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:00 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:01.159198 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-2d0eb04e-7ba6-41e8-846f-5b02940a2488 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:01.159889 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-2d0eb04e-7ba6-41e8-846f-5b02940a2488 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:01.167335 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2d0eb04e-7ba6-41e8-846f-5b02940a2488 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:01.167801 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2d0eb04e-7ba6-41e8-846f-5b02940a2488 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:01.168259 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2d0eb04e-7ba6-41e8-846f-5b02940a2488 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:01.168971 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2d0eb04e-7ba6-41e8-846f-5b02940a2488 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:01.169422 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2d0eb04e-7ba6-41e8-846f-5b02940a2488 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:01.169840 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2d0eb04e-7ba6-41e8-846f-5b02940a2488 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:01.297452 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-2d0eb04e-7ba6-41e8-846f-5b02940a2488 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:01.304785 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-2d0eb04e-7ba6-41e8-846f-5b02940a2488 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1366 microversion: 2.1 time: 0.149861 Aug 17 23:50:01.305346 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 429/836] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:01 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:01.911025 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-de76ae17-bb0e-4eec-9792-e90fdddf62c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:01.911641 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-de76ae17-bb0e-4eec-9792-e90fdddf62c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:01.919694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-de76ae17-bb0e-4eec-9792-e90fdddf62c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:01.920213 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-de76ae17-bb0e-4eec-9792-e90fdddf62c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:01.920650 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-de76ae17-bb0e-4eec-9792-e90fdddf62c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:01.921364 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-de76ae17-bb0e-4eec-9792-e90fdddf62c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:01.921818 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-de76ae17-bb0e-4eec-9792-e90fdddf62c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:01.922238 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-de76ae17-bb0e-4eec-9792-e90fdddf62c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:02.049142 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-de76ae17-bb0e-4eec-9792-e90fdddf62c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:02.056541 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-de76ae17-bb0e-4eec-9792-e90fdddf62c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1676 microversion: 2.1 time: 0.149375 Aug 17 23:50:02.057104 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 408/837] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:01 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:02.237908 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d86aa6dd-ed49-4403-b31a-c4e11bf894d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:02.238433 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d86aa6dd-ed49-4403-b31a-c4e11bf894d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:02.244782 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d86aa6dd-ed49-4403-b31a-c4e11bf894d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:02.245311 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d86aa6dd-ed49-4403-b31a-c4e11bf894d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:02.245750 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d86aa6dd-ed49-4403-b31a-c4e11bf894d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:02.246427 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d86aa6dd-ed49-4403-b31a-c4e11bf894d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:02.246877 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d86aa6dd-ed49-4403-b31a-c4e11bf894d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:02.247297 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d86aa6dd-ed49-4403-b31a-c4e11bf894d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:02.277187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d86aa6dd-ed49-4403-b31a-c4e11bf894d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323/os-volume_attachments/9ab2a79b-a2a7-44bd-aa0e-8ea4ab0e4e25" status: 200 len: 194 microversion: 2.20 time: 0.043270 Aug 17 23:50:02.277735 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 430/838] 10.222.0.26 () {60 vars in 1454 bytes} [Wed Aug 17 23:50:02 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323/os-volume_attachments/9ab2a79b-a2a7-44bd-aa0e-8ea4ab0e4e25 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 23:50:02.325557 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-43b7eea1-a0f3-4170-9515-13eed1e4999d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:02.326172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-43b7eea1-a0f3-4170-9515-13eed1e4999d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:02.336410 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-43b7eea1-a0f3-4170-9515-13eed1e4999d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:02.337692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-43b7eea1-a0f3-4170-9515-13eed1e4999d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:02.338205 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-43b7eea1-a0f3-4170-9515-13eed1e4999d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:02.339512 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-43b7eea1-a0f3-4170-9515-13eed1e4999d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:02.340069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-43b7eea1-a0f3-4170-9515-13eed1e4999d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:02.340632 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-43b7eea1-a0f3-4170-9515-13eed1e4999d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:02.346603 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9bff2272-f9a7-4803-98d2-bedfc35d4333 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:02.347094 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9bff2272-f9a7-4803-98d2-bedfc35d4333 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:02.352915 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9bff2272-f9a7-4803-98d2-bedfc35d4333 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:02.353391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9bff2272-f9a7-4803-98d2-bedfc35d4333 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:02.353824 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9bff2272-f9a7-4803-98d2-bedfc35d4333 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:02.355119 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9bff2272-f9a7-4803-98d2-bedfc35d4333 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:02.355568 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9bff2272-f9a7-4803-98d2-bedfc35d4333 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:02.356005 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9bff2272-f9a7-4803-98d2-bedfc35d4333 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:02.474539 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-43b7eea1-a0f3-4170-9515-13eed1e4999d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:02.481520 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.objects.instance [None req-9bff2272-f9a7-4803-98d2-bedfc35d4333 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lazy-loading 'services' on Instance uuid abc34597-7782-4715-86c3-6a940ecde323 {{(pid=131394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:50:02.482583 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-43b7eea1-a0f3-4170-9515-13eed1e4999d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1366 microversion: 2.1 time: 0.161201 Aug 17 23:50:02.483175 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 409/839] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:02 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:02.592684 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9bff2272-f9a7-4803-98d2-bedfc35d4333 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "DELETE /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323/os-volume_attachments/9ab2a79b-a2a7-44bd-aa0e-8ea4ab0e4e25" status: 202 len: 0 microversion: 2.20 time: 0.249702 Aug 17 23:50:02.593417 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 431/840] 10.222.0.26 () {60 vars in 1457 bytes} [Wed Aug 17 23:50:02 2022] DELETE /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323/os-volume_attachments/9ab2a79b-a2a7-44bd-aa0e-8ea4ab0e4e25 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 23:50:02.601797 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2b7b2ac4-b8bb-4c1f-9f31-1c9205f31432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:02.604095 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2b7b2ac4-b8bb-4c1f-9f31-1c9205f31432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:02.610062 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2b7b2ac4-b8bb-4c1f-9f31-1c9205f31432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:02.610543 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2b7b2ac4-b8bb-4c1f-9f31-1c9205f31432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:02.610976 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2b7b2ac4-b8bb-4c1f-9f31-1c9205f31432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:02.611688 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2b7b2ac4-b8bb-4c1f-9f31-1c9205f31432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:02.612169 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2b7b2ac4-b8bb-4c1f-9f31-1c9205f31432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:02.612590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2b7b2ac4-b8bb-4c1f-9f31-1c9205f31432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:02.640958 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2b7b2ac4-b8bb-4c1f-9f31-1c9205f31432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043160 Aug 17 23:50:02.641509 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 410/841] 10.222.0.26 () {60 vars in 1343 bytes} [Wed Aug 17 23:50:02 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 23:50:03.079634 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c3d47ab5-d59a-4cda-9149-4c4ddd7d2480 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:03.080417 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c3d47ab5-d59a-4cda-9149-4c4ddd7d2480 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:03.086687 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c3d47ab5-d59a-4cda-9149-4c4ddd7d2480 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:03.087162 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c3d47ab5-d59a-4cda-9149-4c4ddd7d2480 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:03.087592 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c3d47ab5-d59a-4cda-9149-4c4ddd7d2480 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:03.088299 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c3d47ab5-d59a-4cda-9149-4c4ddd7d2480 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:03.088757 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c3d47ab5-d59a-4cda-9149-4c4ddd7d2480 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:03.089174 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c3d47ab5-d59a-4cda-9149-4c4ddd7d2480 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:03.219446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c3d47ab5-d59a-4cda-9149-4c4ddd7d2480 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:03.227398 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c3d47ab5-d59a-4cda-9149-4c4ddd7d2480 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1676 microversion: 2.1 time: 0.152623 Aug 17 23:50:03.227948 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 432/842] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:03 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:03.503261 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3b36a6a0-bbc1-467f-ba97-ea8bac8cb863 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:03.503873 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3b36a6a0-bbc1-467f-ba97-ea8bac8cb863 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:03.506298 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:03.511739 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b36a6a0-bbc1-467f-ba97-ea8bac8cb863 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:03.512247 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b36a6a0-bbc1-467f-ba97-ea8bac8cb863 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:03.512711 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b36a6a0-bbc1-467f-ba97-ea8bac8cb863 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:03.513399 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b36a6a0-bbc1-467f-ba97-ea8bac8cb863 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:03.513848 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b36a6a0-bbc1-467f-ba97-ea8bac8cb863 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:03.514269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b36a6a0-bbc1-467f-ba97-ea8bac8cb863 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:03.639616 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3b36a6a0-bbc1-467f-ba97-ea8bac8cb863 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:03.647005 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3b36a6a0-bbc1-467f-ba97-ea8bac8cb863 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1366 microversion: 2.1 time: 0.147606 Aug 17 23:50:03.647561 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 411/843] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:03 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:03.654053 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8325d26c-28a7-46f8-83bf-15467f3e5645 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:03.656310 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8325d26c-28a7-46f8-83bf-15467f3e5645 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:03.662825 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8325d26c-28a7-46f8-83bf-15467f3e5645 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:03.663593 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8325d26c-28a7-46f8-83bf-15467f3e5645 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:03.664067 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8325d26c-28a7-46f8-83bf-15467f3e5645 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:03.664748 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8325d26c-28a7-46f8-83bf-15467f3e5645 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:03.665201 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8325d26c-28a7-46f8-83bf-15467f3e5645 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:03.665618 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8325d26c-28a7-46f8-83bf-15467f3e5645 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:03.694476 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8325d26c-28a7-46f8-83bf-15467f3e5645 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044868 Aug 17 23:50:03.695017 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 433/844] 10.222.0.26 () {60 vars in 1343 bytes} [Wed Aug 17 23:50:03 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 23:50:04.250715 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e759a218-d753-47e1-9daf-29f869512879 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:04.251586 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e759a218-d753-47e1-9daf-29f869512879 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:04.254624 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:04.258689 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e759a218-d753-47e1-9daf-29f869512879 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:04.259283 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e759a218-d753-47e1-9daf-29f869512879 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:04.259786 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e759a218-d753-47e1-9daf-29f869512879 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:04.260593 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e759a218-d753-47e1-9daf-29f869512879 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:04.261119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e759a218-d753-47e1-9daf-29f869512879 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:04.261610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e759a218-d753-47e1-9daf-29f869512879 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:04.403774 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e759a218-d753-47e1-9daf-29f869512879 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:04.412229 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e759a218-d753-47e1-9daf-29f869512879 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1676 microversion: 2.1 time: 0.165579 Aug 17 23:50:04.412743 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 412/845] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:04 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:04.668382 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-5a5a5f53-6bef-40f5-927a-cdd076eea462 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:04.668933 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-5a5a5f53-6bef-40f5-927a-cdd076eea462 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:04.675338 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5a5a5f53-6bef-40f5-927a-cdd076eea462 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:04.675826 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5a5a5f53-6bef-40f5-927a-cdd076eea462 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:04.676309 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5a5a5f53-6bef-40f5-927a-cdd076eea462 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:04.677008 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5a5a5f53-6bef-40f5-927a-cdd076eea462 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:04.677467 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5a5a5f53-6bef-40f5-927a-cdd076eea462 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:04.677900 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5a5a5f53-6bef-40f5-927a-cdd076eea462 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:04.706876 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-65e9a0c2-8f76-4291-be5e-cdc387261be0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:04.709187 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-65e9a0c2-8f76-4291-be5e-cdc387261be0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:04.715842 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-65e9a0c2-8f76-4291-be5e-cdc387261be0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:04.716359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-65e9a0c2-8f76-4291-be5e-cdc387261be0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:04.716808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-65e9a0c2-8f76-4291-be5e-cdc387261be0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:04.717511 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-65e9a0c2-8f76-4291-be5e-cdc387261be0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:04.717969 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-65e9a0c2-8f76-4291-be5e-cdc387261be0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:04.718403 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-65e9a0c2-8f76-4291-be5e-cdc387261be0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:04.748235 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-65e9a0c2-8f76-4291-be5e-cdc387261be0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045178 Aug 17 23:50:04.750189 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 413/846] 10.222.0.26 () {60 vars in 1343 bytes} [Wed Aug 17 23:50:04 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:04.811074 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2c1d7f19-77cf-4d07-8714-ed67f9f8bcf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:04.811577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2c1d7f19-77cf-4d07-8714-ed67f9f8bcf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:04.817473 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2c1d7f19-77cf-4d07-8714-ed67f9f8bcf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:04.817959 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2c1d7f19-77cf-4d07-8714-ed67f9f8bcf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:04.818408 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2c1d7f19-77cf-4d07-8714-ed67f9f8bcf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:04.819105 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2c1d7f19-77cf-4d07-8714-ed67f9f8bcf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:04.819571 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2c1d7f19-77cf-4d07-8714-ed67f9f8bcf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:04.820025 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2c1d7f19-77cf-4d07-8714-ed67f9f8bcf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:04.823375 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5a5a5f53-6bef-40f5-927a-cdd076eea462 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:04.831083 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-5a5a5f53-6bef-40f5-927a-cdd076eea462 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1366 microversion: 2.1 time: 0.166543 Aug 17 23:50:04.832016 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 434/847] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:04 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:04.845425 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2c1d7f19-77cf-4d07-8714-ed67f9f8bcf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Going to try to terminate instance {{(pid=131395) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:50:04.920990 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2c1d7f19-77cf-4d07-8714-ed67f9f8bcf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "DELETE /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 204 len: 0 microversion: 2.20 time: 0.113809 Aug 17 23:50:04.921682 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 414/848] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Aug 17 23:50:04 2022] DELETE /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 17 23:50:04.930505 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-0cd85832-d9e3-48a8-bd8a-15c235225312 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:04.931105 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-0cd85832-d9e3-48a8-bd8a-15c235225312 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:04.937817 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0cd85832-d9e3-48a8-bd8a-15c235225312 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:04.938295 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0cd85832-d9e3-48a8-bd8a-15c235225312 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:04.938988 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0cd85832-d9e3-48a8-bd8a-15c235225312 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:04.939898 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0cd85832-d9e3-48a8-bd8a-15c235225312 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:04.940458 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0cd85832-d9e3-48a8-bd8a-15c235225312 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:04.941023 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0cd85832-d9e3-48a8-bd8a-15c235225312 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:05.076817 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0cd85832-d9e3-48a8-bd8a-15c235225312 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:05.084914 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0cd85832-d9e3-48a8-bd8a-15c235225312 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:05.086421 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0cd85832-d9e3-48a8-bd8a-15c235225312 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:05.087584 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-0cd85832-d9e3-48a8-bd8a-15c235225312 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.161597 Aug 17 23:50:05.088177 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 435/849] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:04 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:50:05.434523 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3b59e98f-0151-4a0e-a753-f74958f0d88b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:05.435229 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3b59e98f-0151-4a0e-a753-f74958f0d88b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:05.441239 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b59e98f-0151-4a0e-a753-f74958f0d88b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:05.441731 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b59e98f-0151-4a0e-a753-f74958f0d88b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:05.442168 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b59e98f-0151-4a0e-a753-f74958f0d88b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:05.442869 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b59e98f-0151-4a0e-a753-f74958f0d88b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:05.443332 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b59e98f-0151-4a0e-a753-f74958f0d88b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:05.443767 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b59e98f-0151-4a0e-a753-f74958f0d88b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:05.447943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:05.540780 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=12 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:05.574106 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3b59e98f-0151-4a0e-a753-f74958f0d88b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:05.581947 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3b59e98f-0151-4a0e-a753-f74958f0d88b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1676 microversion: 2.1 time: 0.151690 Aug 17 23:50:05.582506 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 415/850] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:05 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:05.852409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-bb145391-a3d7-44e7-b87f-a830279dcf85 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:05.853055 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-bb145391-a3d7-44e7-b87f-a830279dcf85 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:05.859545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb145391-a3d7-44e7-b87f-a830279dcf85 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:05.860072 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb145391-a3d7-44e7-b87f-a830279dcf85 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:05.860514 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb145391-a3d7-44e7-b87f-a830279dcf85 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:05.861205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb145391-a3d7-44e7-b87f-a830279dcf85 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:05.861672 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb145391-a3d7-44e7-b87f-a830279dcf85 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:05.862100 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb145391-a3d7-44e7-b87f-a830279dcf85 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:05.995250 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-bb145391-a3d7-44e7-b87f-a830279dcf85 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:06.003168 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-bb145391-a3d7-44e7-b87f-a830279dcf85 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1366 microversion: 2.1 time: 0.154615 Aug 17 23:50:06.003735 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 436/851] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:05 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:06.111655 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-409f908e-5f05-4475-aa42-be6a859216d6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:06.112254 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-409f908e-5f05-4475-aa42-be6a859216d6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:06.118565 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-409f908e-5f05-4475-aa42-be6a859216d6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:06.119045 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-409f908e-5f05-4475-aa42-be6a859216d6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:06.119479 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-409f908e-5f05-4475-aa42-be6a859216d6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:06.120197 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-409f908e-5f05-4475-aa42-be6a859216d6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:06.120652 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-409f908e-5f05-4475-aa42-be6a859216d6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:06.121581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-409f908e-5f05-4475-aa42-be6a859216d6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:06.248371 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-409f908e-5f05-4475-aa42-be6a859216d6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:06.256206 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-409f908e-5f05-4475-aa42-be6a859216d6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:06.257710 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-409f908e-5f05-4475-aa42-be6a859216d6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:06.258857 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-409f908e-5f05-4475-aa42-be6a859216d6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.151150 Aug 17 23:50:06.259444 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 416/852] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:06 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:50:06.517780 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-c225bc16-ac8a-4c01-8360-0d32b7676513 req-b79840cd-3222-4b0c-80c0-162e8fa40011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c039ab07-eda9-4a13-8fd1-faee03623668", "name": "network-vif-plugged", "status": "completed", "tag": "e29cf50e-a8ec-4776-a56a-132e50191ca7"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:50:06.527090 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-c225bc16-ac8a-4c01-8360-0d32b7676513 req-b79840cd-3222-4b0c-80c0-162e8fa40011 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:06.527595 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-c225bc16-ac8a-4c01-8360-0d32b7676513 req-b79840cd-3222-4b0c-80c0-162e8fa40011 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:06.528044 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-c225bc16-ac8a-4c01-8360-0d32b7676513 req-b79840cd-3222-4b0c-80c0-162e8fa40011 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:06.538628 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-c225bc16-ac8a-4c01-8360-0d32b7676513 req-b79840cd-3222-4b0c-80c0-162e8fa40011 service nova] Creating event network-vif-plugged:e29cf50e-a8ec-4776-a56a-132e50191ca7 for instance c039ab07-eda9-4a13-8fd1-faee03623668 on hv-cinder-82002 Aug 17 23:50:06.543980 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-c225bc16-ac8a-4c01-8360-0d32b7676513 req-b79840cd-3222-4b0c-80c0-162e8fa40011 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085770 Aug 17 23:50:06.544709 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 437/853] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:06.603978 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5f0d5ae3-b000-489c-aa6b-8817a03abd6d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:06.604602 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5f0d5ae3-b000-489c-aa6b-8817a03abd6d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:06.611228 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5f0d5ae3-b000-489c-aa6b-8817a03abd6d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:06.611709 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5f0d5ae3-b000-489c-aa6b-8817a03abd6d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:06.612192 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5f0d5ae3-b000-489c-aa6b-8817a03abd6d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:06.612882 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5f0d5ae3-b000-489c-aa6b-8817a03abd6d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:06.613337 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5f0d5ae3-b000-489c-aa6b-8817a03abd6d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:06.613766 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5f0d5ae3-b000-489c-aa6b-8817a03abd6d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:06.753098 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5f0d5ae3-b000-489c-aa6b-8817a03abd6d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:06.760626 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5f0d5ae3-b000-489c-aa6b-8817a03abd6d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1676 microversion: 2.1 time: 0.160495 Aug 17 23:50:06.761194 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 417/854] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:06 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:07.021901 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=6 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:07.026592 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-dca45136-8377-4c0e-a716-ae92989b6d57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:07.027386 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-dca45136-8377-4c0e-a716-ae92989b6d57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:07.041081 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dca45136-8377-4c0e-a716-ae92989b6d57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:07.041584 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dca45136-8377-4c0e-a716-ae92989b6d57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:07.042027 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dca45136-8377-4c0e-a716-ae92989b6d57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:07.042730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dca45136-8377-4c0e-a716-ae92989b6d57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:07.043187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dca45136-8377-4c0e-a716-ae92989b6d57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:07.043615 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dca45136-8377-4c0e-a716-ae92989b6d57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:07.171731 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dca45136-8377-4c0e-a716-ae92989b6d57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:07.179172 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-dca45136-8377-4c0e-a716-ae92989b6d57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1366 microversion: 2.1 time: 0.158250 Aug 17 23:50:07.179743 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 438/855] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:07 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:07.281412 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e339aba6-dce3-4d48-b2c1-46934d236f76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:07.281935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e339aba6-dce3-4d48-b2c1-46934d236f76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:07.288691 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e339aba6-dce3-4d48-b2c1-46934d236f76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:07.289173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e339aba6-dce3-4d48-b2c1-46934d236f76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:07.289610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e339aba6-dce3-4d48-b2c1-46934d236f76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:07.290301 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e339aba6-dce3-4d48-b2c1-46934d236f76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:07.290759 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e339aba6-dce3-4d48-b2c1-46934d236f76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:07.291183 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e339aba6-dce3-4d48-b2c1-46934d236f76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:07.419563 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e339aba6-dce3-4d48-b2c1-46934d236f76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:07.427541 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e339aba6-dce3-4d48-b2c1-46934d236f76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:07.429195 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e339aba6-dce3-4d48-b2c1-46934d236f76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:07.430349 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e339aba6-dce3-4d48-b2c1-46934d236f76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.153569 Aug 17 23:50:07.430901 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 418/856] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:07 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:50:07.781589 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1ea734bd-52ba-40bc-af02-e75f6f3aff16 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:07.782205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1ea734bd-52ba-40bc-af02-e75f6f3aff16 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:07.788372 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1ea734bd-52ba-40bc-af02-e75f6f3aff16 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:07.788853 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1ea734bd-52ba-40bc-af02-e75f6f3aff16 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:07.789290 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1ea734bd-52ba-40bc-af02-e75f6f3aff16 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:07.789971 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1ea734bd-52ba-40bc-af02-e75f6f3aff16 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:07.790426 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1ea734bd-52ba-40bc-af02-e75f6f3aff16 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:07.790852 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1ea734bd-52ba-40bc-af02-e75f6f3aff16 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:07.916362 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1ea734bd-52ba-40bc-af02-e75f6f3aff16 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:07.924227 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1ea734bd-52ba-40bc-af02-e75f6f3aff16 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1676 microversion: 2.1 time: 0.146449 Aug 17 23:50:07.924789 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 439/857] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:07 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:08.199988 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-4e4458b3-2480-43a7-93a4-63cfa2d7358f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:08.200741 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-4e4458b3-2480-43a7-93a4-63cfa2d7358f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:08.206837 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4e4458b3-2480-43a7-93a4-63cfa2d7358f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:08.207330 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4e4458b3-2480-43a7-93a4-63cfa2d7358f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:08.207772 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4e4458b3-2480-43a7-93a4-63cfa2d7358f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:08.208505 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4e4458b3-2480-43a7-93a4-63cfa2d7358f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:08.208970 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4e4458b3-2480-43a7-93a4-63cfa2d7358f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:08.209410 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4e4458b3-2480-43a7-93a4-63cfa2d7358f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:08.437370 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-4e4458b3-2480-43a7-93a4-63cfa2d7358f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:08.446093 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-4e4458b3-2480-43a7-93a4-63cfa2d7358f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1366 microversion: 2.1 time: 0.249975 Aug 17 23:50:08.446696 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 419/858] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:08 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:08.454304 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c03f1f88-9de2-437d-94de-2a576c9509e3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:08.454696 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c03f1f88-9de2-437d-94de-2a576c9509e3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:08.457890 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:08.461625 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c03f1f88-9de2-437d-94de-2a576c9509e3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:08.462111 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c03f1f88-9de2-437d-94de-2a576c9509e3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:08.462555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c03f1f88-9de2-437d-94de-2a576c9509e3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:08.463247 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c03f1f88-9de2-437d-94de-2a576c9509e3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:08.463700 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c03f1f88-9de2-437d-94de-2a576c9509e3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:08.464359 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c03f1f88-9de2-437d-94de-2a576c9509e3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:08.610551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c03f1f88-9de2-437d-94de-2a576c9509e3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:08.617826 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c03f1f88-9de2-437d-94de-2a576c9509e3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:08.619346 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c03f1f88-9de2-437d-94de-2a576c9509e3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:08.620560 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c03f1f88-9de2-437d-94de-2a576c9509e3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1723 microversion: 2.20 time: 0.170500 Aug 17 23:50:08.621132 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 440/859] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:08 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:50:08.946813 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0911a1a1-344b-4b4f-8abd-ebf4b391c24e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:08.947682 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0911a1a1-344b-4b4f-8abd-ebf4b391c24e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:08.955075 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0911a1a1-344b-4b4f-8abd-ebf4b391c24e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:08.955572 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0911a1a1-344b-4b4f-8abd-ebf4b391c24e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:08.956062 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0911a1a1-344b-4b4f-8abd-ebf4b391c24e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:08.956839 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0911a1a1-344b-4b4f-8abd-ebf4b391c24e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:08.957440 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0911a1a1-344b-4b4f-8abd-ebf4b391c24e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:08.957964 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0911a1a1-344b-4b4f-8abd-ebf4b391c24e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:09.182549 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0911a1a1-344b-4b4f-8abd-ebf4b391c24e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:09.190567 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0911a1a1-344b-4b4f-8abd-ebf4b391c24e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1676 microversion: 2.1 time: 0.248451 Aug 17 23:50:09.191141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 420/860] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:08 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1676 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:09.407121 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-104aed7d-6f4e-46b3-bffe-0f5e002dad47 req-0581a04d-9274-49e3-977f-bda51b2b9550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abc34597-7782-4715-86c3-6a940ecde323", "name": "network-vif-deleted", "tag": "bce8dab3-ded2-46e7-a72a-7a52eb3c9201"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:50:09.416741 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-104aed7d-6f4e-46b3-bffe-0f5e002dad47 req-0581a04d-9274-49e3-977f-bda51b2b9550 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:09.417216 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-104aed7d-6f4e-46b3-bffe-0f5e002dad47 req-0581a04d-9274-49e3-977f-bda51b2b9550 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:09.417654 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-104aed7d-6f4e-46b3-bffe-0f5e002dad47 req-0581a04d-9274-49e3-977f-bda51b2b9550 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:09.429396 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-104aed7d-6f4e-46b3-bffe-0f5e002dad47 req-0581a04d-9274-49e3-977f-bda51b2b9550 service nova] Creating event network-vif-deleted:bce8dab3-ded2-46e7-a72a-7a52eb3c9201 for instance abc34597-7782-4715-86c3-6a940ecde323 on hv-cinder-82002 Aug 17 23:50:09.441320 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-104aed7d-6f4e-46b3-bffe-0f5e002dad47 req-0581a04d-9274-49e3-977f-bda51b2b9550 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037573 Aug 17 23:50:09.442214 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 441/861] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:09.467465 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3b9480e2-d30a-45c3-91c6-94783d112aa0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:09.468369 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3b9480e2-d30a-45c3-91c6-94783d112aa0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:09.476097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b9480e2-d30a-45c3-91c6-94783d112aa0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:09.477145 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b9480e2-d30a-45c3-91c6-94783d112aa0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:09.477741 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b9480e2-d30a-45c3-91c6-94783d112aa0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:09.478816 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b9480e2-d30a-45c3-91c6-94783d112aa0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:09.479277 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b9480e2-d30a-45c3-91c6-94783d112aa0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:09.479701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b9480e2-d30a-45c3-91c6-94783d112aa0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:09.630717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3b9480e2-d30a-45c3-91c6-94783d112aa0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:09.638722 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3b9480e2-d30a-45c3-91c6-94783d112aa0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1556 microversion: 2.1 time: 0.175210 Aug 17 23:50:09.639348 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 421/862] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:09 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:09.647636 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1e888ff5-769e-48cf-8ef6-64d1d5c57b6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:09.649855 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1e888ff5-769e-48cf-8ef6-64d1d5c57b6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:09.660260 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c0da1eb1-a34e-4401-84ef-f44af5d514ef tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:09.660773 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c0da1eb1-a34e-4401-84ef-f44af5d514ef tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:09.660962 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1e888ff5-769e-48cf-8ef6-64d1d5c57b6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:09.661638 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1e888ff5-769e-48cf-8ef6-64d1d5c57b6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:09.662505 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1e888ff5-769e-48cf-8ef6-64d1d5c57b6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:09.663387 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1e888ff5-769e-48cf-8ef6-64d1d5c57b6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:09.664040 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1e888ff5-769e-48cf-8ef6-64d1d5c57b6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:09.664646 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1e888ff5-769e-48cf-8ef6-64d1d5c57b6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:09.667675 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0da1eb1-a34e-4401-84ef-f44af5d514ef tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:09.669054 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0da1eb1-a34e-4401-84ef-f44af5d514ef tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:09.669697 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0da1eb1-a34e-4401-84ef-f44af5d514ef tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:09.670519 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0da1eb1-a34e-4401-84ef-f44af5d514ef tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:09.671104 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0da1eb1-a34e-4401-84ef-f44af5d514ef tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:09.671655 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c0da1eb1-a34e-4401-84ef-f44af5d514ef tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:09.703048 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1e888ff5-769e-48cf-8ef6-64d1d5c57b6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:09.703785 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1e888ff5-769e-48cf-8ef6-64d1d5c57b6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:09.704426 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1e888ff5-769e-48cf-8ef6-64d1d5c57b6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:09.705034 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.objects.instance [None req-1e888ff5-769e-48cf-8ef6-64d1d5c57b6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lazy-loading 'fault' on Instance uuid abc34597-7782-4715-86c3-6a940ecde323 {{(pid=131394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:50:09.750512 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1e888ff5-769e-48cf-8ef6-64d1d5c57b6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:09.759272 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1e888ff5-769e-48cf-8ef6-64d1d5c57b6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:09.760876 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1e888ff5-769e-48cf-8ef6-64d1d5c57b6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:09.762159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1e888ff5-769e-48cf-8ef6-64d1d5c57b6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 200 len: 1371 microversion: 2.20 time: 0.121926 Aug 17 23:50:09.762933 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 442/863] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:09 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 1371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:50:09.771149 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c0da1eb1-a34e-4401-84ef-f44af5d514ef tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115137 Aug 17 23:50:09.772038 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 422/864] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Aug 17 23:50:09 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:10.212569 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-194c03d9-b583-40ed-9776-1d96426d5abc tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:10.213190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-194c03d9-b583-40ed-9776-1d96426d5abc tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:10.220365 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-194c03d9-b583-40ed-9776-1d96426d5abc tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:10.220856 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-194c03d9-b583-40ed-9776-1d96426d5abc tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:10.221295 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-194c03d9-b583-40ed-9776-1d96426d5abc tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:10.221992 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-194c03d9-b583-40ed-9776-1d96426d5abc tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:10.222446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-194c03d9-b583-40ed-9776-1d96426d5abc tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:10.222871 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-194c03d9-b583-40ed-9776-1d96426d5abc tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:10.227182 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:10.368344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-194c03d9-b583-40ed-9776-1d96426d5abc tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:10.385272 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-194c03d9-b583-40ed-9776-1d96426d5abc tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1676 microversion: 2.1 time: 0.176544 Aug 17 23:50:10.392590 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 443/865] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:10 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:10.787099 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1a5b106a-5a94-44f1-a02c-efbd89745d68 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:10.787797 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-1a5b106a-5a94-44f1-a02c-efbd89745d68 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:10.794307 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1a5b106a-5a94-44f1-a02c-efbd89745d68 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:10.794791 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1a5b106a-5a94-44f1-a02c-efbd89745d68 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:10.795232 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1a5b106a-5a94-44f1-a02c-efbd89745d68 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:10.795943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1a5b106a-5a94-44f1-a02c-efbd89745d68 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:10.796414 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1a5b106a-5a94-44f1-a02c-efbd89745d68 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:10.796838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1a5b106a-5a94-44f1-a02c-efbd89745d68 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:10.810662 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-1a5b106a-5a94-44f1-a02c-efbd89745d68 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] HTTP exception thrown: Instance abc34597-7782-4715-86c3-6a940ecde323 could not be found. Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1a5b106a-5a94-44f1-a02c-efbd89745d68 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Request method failure captured: Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 HTTP/1.1 Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X0gZE9JlbYKTrrLiW4VAbW3COer-I9kHd2IqEFzvb3q6K2--HStbtrYSQEwHc0VJYBmCOAMxPH9VaJ2a5Ezse8PxLuEhuMa9MOQzMvq7y53bOiv3GyTjnby9zW3Dzuh1lONZvvKOsoAO5tKYLtmbwRNqtn_SsQmbGPgAPNlHJTeSWo Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: d9574c6bc0ea4f78a0145fc2764a6fa9 Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1876855194 Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:50:10.812335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:50:10.814014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d9574c6bc0ea4f78a0145fc2764a6fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d9574c6bc0ea4f78a0145fc2764a6fa9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9574c6bc0ea4f78a0145fc2764a6fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9574c6bc0ea4f78a0145fc2764a6fa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:50:10.814014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1876855194 Aug 17 23:50:10.814014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: d9574c6bc0ea4f78a0145fc2764a6fa9 Aug 17 23:50:10.814014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1876855194 Aug 17 23:50:10.814014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-AttachVolumeShelveTestJSON-1876855194-project Aug 17 23:50:10.814014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:50:10.814014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:50:10.814014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 2da686247e7f490ab7924d0456da60d5 Aug 17 23:50:10.814014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1876855194-project Aug 17 23:50:10.814014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:50:10.814014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance abc34597-7782-4715-86c3-6a940ecde323 could not be found. Aug 17 23:50:10.814014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': 'abc34597-7782-4715-86c3-6a940ecde323'} Aug 17 23:50:10.815039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:50:10.815039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:50:10.815039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:50:10.815039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:50:10.815039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:50:10.815039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:50:10.815039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:50:10.815039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:50:10.815039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:50:10.815039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:50:10.815039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abc34597-7782-4715-86c3-6a940ecde323 could not be found. Aug 17 23:50:10.815039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:50:10.815039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:50:10.815039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:50:10.815039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:50:10.815039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:50:10.815039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:50:10.815039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:50:10.815039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:50:10.815039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:50:10.816606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:50:10.816606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:50:10.816606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:50:10.816606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:50:10.816606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:50:10.816606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:50:10.816606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:50:10.816606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abc34597-7782-4715-86c3-6a940ecde323 could not be found. Aug 17 23:50:10.816606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:50:10.816606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:50:10.816606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:50:10.816606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:50:10.816606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:50:10.816606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:50:10.816606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:50:10.816606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:50:10.816606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abc34597-7782-4715-86c3-6a940ecde323 could not be found. Aug 17 23:50:10.816606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:50:10.817896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1a5b106a-5a94-44f1-a02c-efbd89745d68 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Returning 404 to user: Instance abc34597-7782-4715-86c3-6a940ecde323 could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:50:10.817896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-1a5b106a-5a94-44f1-a02c-efbd89745d68 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 404 len: 111 microversion: 2.20 time: 0.031441 Aug 17 23:50:10.817896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 423/866] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:10 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 23:50:10.822488 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1e74d1f6-82bf-41c1-9481-ca6b159c52f7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '.version_select at 0x7f85fd913820>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:10.842264 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1e74d1f6-82bf-41c1-9481-ca6b159c52f7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-298744942" status: 204 len: 0 microversion: 2.20 time: 0.023180 Aug 17 23:50:10.842907 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 444/867] 10.222.0.26 () {60 vars in 1259 bytes} [Wed Aug 17 23:50:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-298744942 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 23:50:11.409722 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-70c9dfaf-5c7f-45d9-838a-219258875e81 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:11.410605 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-70c9dfaf-5c7f-45d9-838a-219258875e81 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:11.416974 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-70c9dfaf-5c7f-45d9-838a-219258875e81 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:11.417670 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-70c9dfaf-5c7f-45d9-838a-219258875e81 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:11.418968 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-70c9dfaf-5c7f-45d9-838a-219258875e81 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:11.419583 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-70c9dfaf-5c7f-45d9-838a-219258875e81 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:11.420065 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-70c9dfaf-5c7f-45d9-838a-219258875e81 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:11.420656 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-70c9dfaf-5c7f-45d9-838a-219258875e81 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:11.444381 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d3d4658c-45b0-445a-be5b-4479cd3cddf5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Action: 'create', calling method: .version_select at 0x7f85fd9988b0>, body: {"keypair": {"name": "tempest-keypair-1499061896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4u1apojwqt/G3dbK/YMA03Ed2XcpK/xR4HGgaooAGLcFY68S69DoCa9dufi2p89nEmvPKVelrpY0EtNTRq7U6347syXCrKFGqtscgwpzgJDnxPxgpm9TwAH4XUa0sScA=="}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:50:11.472073 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-d3d4658c-45b0-445a-be5b-4479cd3cddf5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Getting quotas for project d9574c6bc0ea4f78a0145fc2764a6fa9. Resources: {'key_pairs'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:50:11.476187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-d3d4658c-45b0-445a-be5b-4479cd3cddf5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Getting quotas for user 2da686247e7f490ab7924d0456da60d5 and project d9574c6bc0ea4f78a0145fc2764a6fa9. Resources: {'key_pairs'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:50:11.507329 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d3d4658c-45b0-445a-be5b-4479cd3cddf5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.066608 Aug 17 23:50:11.514417 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 445/868] 10.222.0.26 () {62 vars in 1200 bytes} [Wed Aug 17 23:50:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 17 23:50:11.514417 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-7bc74354-8d59-4404-a6b7-d058ebb57810 req-b74c129b-2af3-40fd-81d3-ec8202d32dae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c039ab07-eda9-4a13-8fd1-faee03623668", "tag": "e29cf50e-a8ec-4776-a56a-132e50191ca7"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:50:11.522346 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-7bc74354-8d59-4404-a6b7-d058ebb57810 req-b74c129b-2af3-40fd-81d3-ec8202d32dae service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:11.522827 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-7bc74354-8d59-4404-a6b7-d058ebb57810 req-b74c129b-2af3-40fd-81d3-ec8202d32dae service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:11.523255 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-7bc74354-8d59-4404-a6b7-d058ebb57810 req-b74c129b-2af3-40fd-81d3-ec8202d32dae service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:11.535899 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-7bc74354-8d59-4404-a6b7-d058ebb57810 req-b74c129b-2af3-40fd-81d3-ec8202d32dae service nova] Creating event network-changed:e29cf50e-a8ec-4776-a56a-132e50191ca7 for instance c039ab07-eda9-4a13-8fd1-faee03623668 on hv-cinder-82002 Aug 17 23:50:11.541370 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-7bc74354-8d59-4404-a6b7-d058ebb57810 req-b74c129b-2af3-40fd-81d3-ec8202d32dae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032137 Aug 17 23:50:11.542303 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 446/869] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:11.592753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-70c9dfaf-5c7f-45d9-838a-219258875e81 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:11.606017 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-70c9dfaf-5c7f-45d9-838a-219258875e81 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1676 microversion: 2.1 time: 0.200383 Aug 17 23:50:11.607172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 424/870] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:11 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1676 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:12.627857 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-df065fcd-961f-4244-becc-a911ffb3e4c4 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:12.628645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-df065fcd-961f-4244-becc-a911ffb3e4c4 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:12.634696 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df065fcd-961f-4244-becc-a911ffb3e4c4 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:12.635291 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df065fcd-961f-4244-becc-a911ffb3e4c4 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:12.635795 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df065fcd-961f-4244-becc-a911ffb3e4c4 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:12.636608 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df065fcd-961f-4244-becc-a911ffb3e4c4 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:12.637133 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df065fcd-961f-4244-becc-a911ffb3e4c4 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:12.637557 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df065fcd-961f-4244-becc-a911ffb3e4c4 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:12.848739 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-df065fcd-961f-4244-becc-a911ffb3e4c4 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:12.856972 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-df065fcd-961f-4244-becc-a911ffb3e4c4 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1676 microversion: 2.1 time: 0.234037 Aug 17 23:50:12.857547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 447/871] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:12 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1676 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:12.888252 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-7dae4145-2804-4e78-90c7-2231379a2d37 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1769777048", "imageRef": "a3cf81e5-e973-4c08-b1da-4e8f104b52a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed727300-4b01-4f41-a5fa-506d64f178aa"}], "security_groups": [{"name": "tempest-securitygroup--608566097"}], "key_name": "tempest-keypair-1499061896", "user_data": "}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:50:12.990288 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.network.neutron [None req-7dae4145-2804-4e78-90c7-2231379a2d37 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] validate_networks() for [('ed727300-4b01-4f41-a5fa-506d64f178aa', None, None, None, None, None)] {{(pid=131395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:50:13.353919 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-7dae4145-2804-4e78-90c7-2231379a2d37 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Flavor limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:50:13.354344 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-7dae4145-2804-4e78-90c7-2231379a2d37 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Image limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:50:13.354817 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-7dae4145-2804-4e78-90c7-2231379a2d37 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Flavor pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:50:13.355230 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-7dae4145-2804-4e78-90c7-2231379a2d37 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Image pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:50:13.355643 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-7dae4145-2804-4e78-90c7-2231379a2d37 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:50:13.364307 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7dae4145-2804-4e78-90c7-2231379a2d37 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:13.364783 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7dae4145-2804-4e78-90c7-2231379a2d37 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:13.365213 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7dae4145-2804-4e78-90c7-2231379a2d37 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:13.366052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7dae4145-2804-4e78-90c7-2231379a2d37 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:13.366507 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7dae4145-2804-4e78-90c7-2231379a2d37 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:13.366932 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7dae4145-2804-4e78-90c7-2231379a2d37 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:13.383698 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-7dae4145-2804-4e78-90c7-2231379a2d37 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Getting quotas for project d9574c6bc0ea4f78a0145fc2764a6fa9. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:50:13.388309 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-7dae4145-2804-4e78-90c7-2231379a2d37 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Getting quotas for user 2da686247e7f490ab7924d0456da60d5 and project d9574c6bc0ea4f78a0145fc2764a6fa9. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:50:13.399095 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-7dae4145-2804-4e78-90c7-2231379a2d37 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Going to run 1 instances... {{(pid=131395) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:50:13.401332 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-7dae4145-2804-4e78-90c7-2231379a2d37 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a3cf81e5-e973-4c08-b1da-4e8f104b52a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:50:13.447046 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-7dae4145-2804-4e78-90c7-2231379a2d37 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.563041 Aug 17 23:50:13.453391 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 425/872] 10.222.0.26 () {62 vars in 1188 bytes} [Wed Aug 17 23:50:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 17 23:50:13.459128 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a4421915-1a67-40f5-a8e1-e93bd52d68ad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:13.459742 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a4421915-1a67-40f5-a8e1-e93bd52d68ad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:13.516901 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a4421915-1a67-40f5-a8e1-e93bd52d68ad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:13.524272 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a4421915-1a67-40f5-a8e1-e93bd52d68ad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:13.525829 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a4421915-1a67-40f5-a8e1-e93bd52d68ad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:13.526943 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a4421915-1a67-40f5-a8e1-e93bd52d68ad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1282 microversion: 2.20 time: 0.071672 Aug 17 23:50:13.527501 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 448/873] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:13 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:50:13.878131 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-42c183fa-69b8-4054-afed-1f90dde3f26a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:13.878865 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-42c183fa-69b8-4054-afed-1f90dde3f26a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:13.885092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-42c183fa-69b8-4054-afed-1f90dde3f26a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:13.885622 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-42c183fa-69b8-4054-afed-1f90dde3f26a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:13.886395 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-42c183fa-69b8-4054-afed-1f90dde3f26a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:13.887273 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-42c183fa-69b8-4054-afed-1f90dde3f26a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:13.887819 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-42c183fa-69b8-4054-afed-1f90dde3f26a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:13.888444 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-42c183fa-69b8-4054-afed-1f90dde3f26a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:13.956953 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 23:50:13.957468 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Wed Aug 17 23:50:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 23:50:14.022435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-42c183fa-69b8-4054-afed-1f90dde3f26a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:14.030435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-42c183fa-69b8-4054-afed-1f90dde3f26a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1676 microversion: 2.1 time: 0.156136 Aug 17 23:50:14.031003 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 426/874] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:13 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:14.549247 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-fa730569-a6ca-412b-8102-a9f038851f17 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:14.550297 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-fa730569-a6ca-412b-8102-a9f038851f17 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:14.557617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa730569-a6ca-412b-8102-a9f038851f17 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:14.558096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa730569-a6ca-412b-8102-a9f038851f17 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:14.558528 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa730569-a6ca-412b-8102-a9f038851f17 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:14.559218 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa730569-a6ca-412b-8102-a9f038851f17 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:14.559665 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa730569-a6ca-412b-8102-a9f038851f17 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:14.560109 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa730569-a6ca-412b-8102-a9f038851f17 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:14.635517 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-fa730569-a6ca-412b-8102-a9f038851f17 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:14.644822 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-fa730569-a6ca-412b-8102-a9f038851f17 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:14.646461 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-fa730569-a6ca-412b-8102-a9f038851f17 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:14.647571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-fa730569-a6ca-412b-8102-a9f038851f17 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1342 microversion: 2.20 time: 0.102305 Aug 17 23:50:14.648150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 449/875] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:14 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1342 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:50:15.053103 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-98eda4d5-6077-4179-9e9c-bad2d94a74c3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:15.053809 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-98eda4d5-6077-4179-9e9c-bad2d94a74c3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:15.061689 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-98eda4d5-6077-4179-9e9c-bad2d94a74c3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:15.063016 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-98eda4d5-6077-4179-9e9c-bad2d94a74c3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:15.063472 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-98eda4d5-6077-4179-9e9c-bad2d94a74c3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:15.064605 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-98eda4d5-6077-4179-9e9c-bad2d94a74c3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:15.065069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-98eda4d5-6077-4179-9e9c-bad2d94a74c3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:15.065501 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-98eda4d5-6077-4179-9e9c-bad2d94a74c3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:15.264187 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-98eda4d5-6077-4179-9e9c-bad2d94a74c3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:15.274536 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-98eda4d5-6077-4179-9e9c-bad2d94a74c3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1653 microversion: 2.1 time: 0.223510 Aug 17 23:50:15.275154 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 427/876] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:15 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1653 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:15.296280 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-81d0efe8-5384-4e68-b879-cfb3cb65ca61 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:50:15.304318 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-81d0efe8-5384-4e68-b879-cfb3cb65ca61 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:15.304805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-81d0efe8-5384-4e68-b879-cfb3cb65ca61 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:15.305246 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-81d0efe8-5384-4e68-b879-cfb3cb65ca61 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:15.366987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-81d0efe8-5384-4e68-b879-cfb3cb65ca61 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Going to try to start instance {{(pid=131394) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 17 23:50:15.409387 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-81d0efe8-5384-4e68-b879-cfb3cb65ca61 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "POST /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227/action" status: 202 len: 0 microversion: 2.1 time: 0.117224 Aug 17 23:50:15.409988 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 450/877] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 17 23:50:15 2022] POST /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 23:50:15.425372 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f50922b8-a6aa-419c-912b-fc8bb479b32d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:15.426123 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f50922b8-a6aa-419c-912b-fc8bb479b32d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:15.432515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f50922b8-a6aa-419c-912b-fc8bb479b32d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:15.432950 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f50922b8-a6aa-419c-912b-fc8bb479b32d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:15.433573 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f50922b8-a6aa-419c-912b-fc8bb479b32d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:15.434281 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f50922b8-a6aa-419c-912b-fc8bb479b32d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:15.434744 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f50922b8-a6aa-419c-912b-fc8bb479b32d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:15.435176 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f50922b8-a6aa-419c-912b-fc8bb479b32d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:15.671996 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d607a3f9-0e9f-40f2-8010-f49fb5ccac8e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:15.673019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d607a3f9-0e9f-40f2-8010-f49fb5ccac8e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:15.680183 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d607a3f9-0e9f-40f2-8010-f49fb5ccac8e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:15.681010 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d607a3f9-0e9f-40f2-8010-f49fb5ccac8e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:15.681506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d607a3f9-0e9f-40f2-8010-f49fb5ccac8e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:15.682318 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d607a3f9-0e9f-40f2-8010-f49fb5ccac8e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:15.682904 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d607a3f9-0e9f-40f2-8010-f49fb5ccac8e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:15.683903 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d607a3f9-0e9f-40f2-8010-f49fb5ccac8e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:15.685232 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f50922b8-a6aa-419c-912b-fc8bb479b32d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:15.693647 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f50922b8-a6aa-419c-912b-fc8bb479b32d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1662 microversion: 2.1 time: 0.272782 Aug 17 23:50:15.694808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 428/878] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:15 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1662 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:15.912858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d607a3f9-0e9f-40f2-8010-f49fb5ccac8e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:15.921138 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d607a3f9-0e9f-40f2-8010-f49fb5ccac8e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:15.922666 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d607a3f9-0e9f-40f2-8010-f49fb5ccac8e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:15.923787 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d607a3f9-0e9f-40f2-8010-f49fb5ccac8e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1407 microversion: 2.20 time: 0.256537 Aug 17 23:50:15.924374 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 451/879] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:15 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:50:16.401506 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-7c5e6234-e40f-47ad-874e-87af5ef3a85b req-eae93b65-e944-4845-9693-f1941c1a5140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "011c37dd-ede6-411d-b147-395b6e36ec9d", "tag": "1cf07451-1bbc-4e01-a03f-428d2ab9b4b7"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:50:16.417357 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-7c5e6234-e40f-47ad-874e-87af5ef3a85b req-eae93b65-e944-4845-9693-f1941c1a5140 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:16.418422 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-7c5e6234-e40f-47ad-874e-87af5ef3a85b req-eae93b65-e944-4845-9693-f1941c1a5140 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:16.418849 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-7c5e6234-e40f-47ad-874e-87af5ef3a85b req-eae93b65-e944-4845-9693-f1941c1a5140 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:16.434391 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-7c5e6234-e40f-47ad-874e-87af5ef3a85b req-eae93b65-e944-4845-9693-f1941c1a5140 service nova] Creating event network-changed:1cf07451-1bbc-4e01-a03f-428d2ab9b4b7 for instance 011c37dd-ede6-411d-b147-395b6e36ec9d on hv-cinder-82002 Aug 17 23:50:16.440913 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-7c5e6234-e40f-47ad-874e-87af5ef3a85b req-eae93b65-e944-4845-9693-f1941c1a5140 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042274 Aug 17 23:50:16.440913 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 429/880] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:16.720189 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-fc8de711-cf44-47aa-b21e-34466c3116f6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:16.720813 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-fc8de711-cf44-47aa-b21e-34466c3116f6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:16.727176 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fc8de711-cf44-47aa-b21e-34466c3116f6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:16.727644 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fc8de711-cf44-47aa-b21e-34466c3116f6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:16.728115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fc8de711-cf44-47aa-b21e-34466c3116f6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:16.728812 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fc8de711-cf44-47aa-b21e-34466c3116f6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:16.729272 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fc8de711-cf44-47aa-b21e-34466c3116f6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:16.729699 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fc8de711-cf44-47aa-b21e-34466c3116f6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:16.862666 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-fc8de711-cf44-47aa-b21e-34466c3116f6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:16.870096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-fc8de711-cf44-47aa-b21e-34466c3116f6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1662 microversion: 2.1 time: 0.153794 Aug 17 23:50:16.870653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 452/881] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:16 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:16.947609 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-261f2da5-982d-4126-86ba-d9a30ddf331e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:16.948333 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-261f2da5-982d-4126-86ba-d9a30ddf331e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:16.954626 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-261f2da5-982d-4126-86ba-d9a30ddf331e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:16.955103 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-261f2da5-982d-4126-86ba-d9a30ddf331e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:16.955538 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-261f2da5-982d-4126-86ba-d9a30ddf331e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:16.956248 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-261f2da5-982d-4126-86ba-d9a30ddf331e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:16.956702 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-261f2da5-982d-4126-86ba-d9a30ddf331e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:16.957122 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-261f2da5-982d-4126-86ba-d9a30ddf331e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:17.092958 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-261f2da5-982d-4126-86ba-d9a30ddf331e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:17.101148 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-261f2da5-982d-4126-86ba-d9a30ddf331e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:17.102675 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-261f2da5-982d-4126-86ba-d9a30ddf331e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:17.103771 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-261f2da5-982d-4126-86ba-d9a30ddf331e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1407 microversion: 2.20 time: 0.160655 Aug 17 23:50:17.104352 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 430/882] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:16 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:50:17.891456 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-25da5d7c-dc28-492f-b837-345065435d7e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:17.892108 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-25da5d7c-dc28-492f-b837-345065435d7e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:17.898522 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-25da5d7c-dc28-492f-b837-345065435d7e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:17.899005 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-25da5d7c-dc28-492f-b837-345065435d7e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:17.899446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-25da5d7c-dc28-492f-b837-345065435d7e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:17.900172 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-25da5d7c-dc28-492f-b837-345065435d7e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:17.900634 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-25da5d7c-dc28-492f-b837-345065435d7e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:17.901061 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-25da5d7c-dc28-492f-b837-345065435d7e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:18.030727 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-25da5d7c-dc28-492f-b837-345065435d7e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:18.038421 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-25da5d7c-dc28-492f-b837-345065435d7e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1666 microversion: 2.1 time: 0.150875 Aug 17 23:50:18.038986 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 453/883] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:17 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1666 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:18.126615 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5d133823-7d31-4d3e-8af0-492c29900d59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:18.127193 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5d133823-7d31-4d3e-8af0-492c29900d59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:18.133694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d133823-7d31-4d3e-8af0-492c29900d59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:18.134173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d133823-7d31-4d3e-8af0-492c29900d59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:18.134606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d133823-7d31-4d3e-8af0-492c29900d59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:18.135293 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d133823-7d31-4d3e-8af0-492c29900d59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:18.135750 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d133823-7d31-4d3e-8af0-492c29900d59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:18.136198 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5d133823-7d31-4d3e-8af0-492c29900d59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:18.262934 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5d133823-7d31-4d3e-8af0-492c29900d59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:18.270903 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5d133823-7d31-4d3e-8af0-492c29900d59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:18.272440 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5d133823-7d31-4d3e-8af0-492c29900d59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:18.273560 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5d133823-7d31-4d3e-8af0-492c29900d59 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1407 microversion: 2.20 time: 0.150920 Aug 17 23:50:18.274131 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 431/884] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:18 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:50:19.296761 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-84615c10-68cf-44b6-bd8b-e299bf109ebe tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:19.297379 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-84615c10-68cf-44b6-bd8b-e299bf109ebe tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:19.303758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-84615c10-68cf-44b6-bd8b-e299bf109ebe tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:19.304278 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-84615c10-68cf-44b6-bd8b-e299bf109ebe tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:19.304720 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-84615c10-68cf-44b6-bd8b-e299bf109ebe tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:19.305408 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-84615c10-68cf-44b6-bd8b-e299bf109ebe tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:19.305867 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-84615c10-68cf-44b6-bd8b-e299bf109ebe tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:19.306294 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-84615c10-68cf-44b6-bd8b-e299bf109ebe tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:19.432374 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-84615c10-68cf-44b6-bd8b-e299bf109ebe tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:19.440745 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-84615c10-68cf-44b6-bd8b-e299bf109ebe tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:19.442342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-84615c10-68cf-44b6-bd8b-e299bf109ebe tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:19.443438 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-84615c10-68cf-44b6-bd8b-e299bf109ebe tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1407 microversion: 2.20 time: 0.151179 Aug 17 23:50:19.444009 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 454/885] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:19 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:50:20.036351 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0d2ca9c8-7fae-4386-b8bb-02cb5f83b751 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:20.037130 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0d2ca9c8-7fae-4386-b8bb-02cb5f83b751 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:20.043126 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0d2ca9c8-7fae-4386-b8bb-02cb5f83b751 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:20.044213 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0d2ca9c8-7fae-4386-b8bb-02cb5f83b751 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:20.044646 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0d2ca9c8-7fae-4386-b8bb-02cb5f83b751 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:20.045327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0d2ca9c8-7fae-4386-b8bb-02cb5f83b751 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:20.045781 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0d2ca9c8-7fae-4386-b8bb-02cb5f83b751 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:20.046202 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0d2ca9c8-7fae-4386-b8bb-02cb5f83b751 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:20.122903 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.objects.instance [None req-0d2ca9c8-7fae-4386-b8bb-02cb5f83b751 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lazy-loading 'services' on Instance uuid 20b73d6d-ce40-4adb-bbd2-7ac326eb758a {{(pid=131395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:50:20.194977 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0d2ca9c8-7fae-4386-b8bb-02cb5f83b751 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "DELETE /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/os-volume_attachments/29ec83ec-a285-443e-a8f3-92c83d6628a4" status: 202 len: 0 microversion: 2.1 time: 0.162367 Aug 17 23:50:20.195581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 432/886] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 17 23:50:20 2022] DELETE /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/os-volume_attachments/29ec83ec-a285-443e-a8f3-92c83d6628a4 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:50:20.204109 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8276b136-20e6-4923-9b2e-eea0d988645e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:20.206563 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8276b136-20e6-4923-9b2e-eea0d988645e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:20.213969 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8276b136-20e6-4923-9b2e-eea0d988645e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:20.214485 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8276b136-20e6-4923-9b2e-eea0d988645e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:20.214929 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8276b136-20e6-4923-9b2e-eea0d988645e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:20.216189 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8276b136-20e6-4923-9b2e-eea0d988645e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:20.216906 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8276b136-20e6-4923-9b2e-eea0d988645e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:20.217138 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8276b136-20e6-4923-9b2e-eea0d988645e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:20.248237 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8276b136-20e6-4923-9b2e-eea0d988645e tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048001 Aug 17 23:50:20.248710 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 455/887] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:50:20 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:20.467582 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b6b6f7c3-7e5d-4985-b994-082299ccf220 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:20.468318 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b6b6f7c3-7e5d-4985-b994-082299ccf220 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:20.474443 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b6b6f7c3-7e5d-4985-b994-082299ccf220 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:20.474929 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b6b6f7c3-7e5d-4985-b994-082299ccf220 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:20.475367 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b6b6f7c3-7e5d-4985-b994-082299ccf220 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:20.476162 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b6b6f7c3-7e5d-4985-b994-082299ccf220 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:20.476624 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b6b6f7c3-7e5d-4985-b994-082299ccf220 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:20.477048 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b6b6f7c3-7e5d-4985-b994-082299ccf220 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:20.495814 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:20.609435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b6b6f7c3-7e5d-4985-b994-082299ccf220 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:20.617368 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b6b6f7c3-7e5d-4985-b994-082299ccf220 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:20.618874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b6b6f7c3-7e5d-4985-b994-082299ccf220 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:20.619990 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b6b6f7c3-7e5d-4985-b994-082299ccf220 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1407 microversion: 2.20 time: 0.157486 Aug 17 23:50:20.620548 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 433/888] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:20 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:50:21.261592 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-47473e22-7ddb-467d-817e-6b6e9a527ef3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:21.264371 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-47473e22-7ddb-467d-817e-6b6e9a527ef3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:21.270658 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-47473e22-7ddb-467d-817e-6b6e9a527ef3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:21.271140 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-47473e22-7ddb-467d-817e-6b6e9a527ef3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:21.271582 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-47473e22-7ddb-467d-817e-6b6e9a527ef3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:21.272310 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-47473e22-7ddb-467d-817e-6b6e9a527ef3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:21.272766 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-47473e22-7ddb-467d-817e-6b6e9a527ef3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:21.273190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-47473e22-7ddb-467d-817e-6b6e9a527ef3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:21.303149 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-47473e22-7ddb-467d-817e-6b6e9a527ef3 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046300 Aug 17 23:50:21.303699 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 456/889] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:50:21 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:21.642069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0ee1cdf1-2344-43a1-b252-26a5410ad4ad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:21.642684 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0ee1cdf1-2344-43a1-b252-26a5410ad4ad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:21.649149 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0ee1cdf1-2344-43a1-b252-26a5410ad4ad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:21.649636 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0ee1cdf1-2344-43a1-b252-26a5410ad4ad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:21.650075 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0ee1cdf1-2344-43a1-b252-26a5410ad4ad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:21.650765 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0ee1cdf1-2344-43a1-b252-26a5410ad4ad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:21.651222 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0ee1cdf1-2344-43a1-b252-26a5410ad4ad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:21.651647 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0ee1cdf1-2344-43a1-b252-26a5410ad4ad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:21.782206 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0ee1cdf1-2344-43a1-b252-26a5410ad4ad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:21.790233 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0ee1cdf1-2344-43a1-b252-26a5410ad4ad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:21.791726 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0ee1cdf1-2344-43a1-b252-26a5410ad4ad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:21.792839 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0ee1cdf1-2344-43a1-b252-26a5410ad4ad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1407 microversion: 2.20 time: 0.154666 Aug 17 23:50:21.794018 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 434/890] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:21 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:50:22.315914 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-5b9dfa69-a5f1-4ddb-86e9-02aa2d8c9e8b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:22.318039 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-5b9dfa69-a5f1-4ddb-86e9-02aa2d8c9e8b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:22.325148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5b9dfa69-a5f1-4ddb-86e9-02aa2d8c9e8b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:22.325638 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5b9dfa69-a5f1-4ddb-86e9-02aa2d8c9e8b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:22.326077 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5b9dfa69-a5f1-4ddb-86e9-02aa2d8c9e8b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:22.326761 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5b9dfa69-a5f1-4ddb-86e9-02aa2d8c9e8b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:22.327218 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5b9dfa69-a5f1-4ddb-86e9-02aa2d8c9e8b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:22.327644 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5b9dfa69-a5f1-4ddb-86e9-02aa2d8c9e8b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:22.356720 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-5b9dfa69-a5f1-4ddb-86e9-02aa2d8c9e8b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044773 Aug 17 23:50:22.357258 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 457/891] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:50:22 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 23:50:22.431019 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-20b506df-a6f2-4e1a-b6b1-36b6f8aa1632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:22.431436 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-20b506df-a6f2-4e1a-b6b1-36b6f8aa1632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:22.437850 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-20b506df-a6f2-4e1a-b6b1-36b6f8aa1632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:22.438331 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-20b506df-a6f2-4e1a-b6b1-36b6f8aa1632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:22.442798 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-20b506df-a6f2-4e1a-b6b1-36b6f8aa1632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:22.442798 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-20b506df-a6f2-4e1a-b6b1-36b6f8aa1632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:22.442798 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-20b506df-a6f2-4e1a-b6b1-36b6f8aa1632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:22.442798 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-20b506df-a6f2-4e1a-b6b1-36b6f8aa1632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:22.466327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-20b506df-a6f2-4e1a-b6b1-36b6f8aa1632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Going to try to terminate instance {{(pid=131395) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:50:22.547150 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-20b506df-a6f2-4e1a-b6b1-36b6f8aa1632 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "DELETE /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 204 len: 0 microversion: 2.1 time: 0.119653 Aug 17 23:50:22.547783 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 435/892] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:50:22 2022] DELETE /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 23:50:22.555766 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a8685257-13c8-415f-85a7-9f56275b7206 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:22.556396 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a8685257-13c8-415f-85a7-9f56275b7206 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:22.562664 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a8685257-13c8-415f-85a7-9f56275b7206 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:22.563146 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a8685257-13c8-415f-85a7-9f56275b7206 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:22.563578 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a8685257-13c8-415f-85a7-9f56275b7206 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:22.564287 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a8685257-13c8-415f-85a7-9f56275b7206 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:22.564756 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a8685257-13c8-415f-85a7-9f56275b7206 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:22.565159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a8685257-13c8-415f-85a7-9f56275b7206 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:22.699295 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a8685257-13c8-415f-85a7-9f56275b7206 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:22.706880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a8685257-13c8-415f-85a7-9f56275b7206 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1687 microversion: 2.1 time: 0.154898 Aug 17 23:50:22.707460 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 458/893] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:22 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:22.815927 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-7bdc5720-14bb-4fd7-9db0-24f3982fb123 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:22.816730 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-7bdc5720-14bb-4fd7-9db0-24f3982fb123 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:22.822978 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7bdc5720-14bb-4fd7-9db0-24f3982fb123 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:22.823468 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7bdc5720-14bb-4fd7-9db0-24f3982fb123 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:22.823911 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7bdc5720-14bb-4fd7-9db0-24f3982fb123 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:22.824655 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7bdc5720-14bb-4fd7-9db0-24f3982fb123 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:22.825115 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7bdc5720-14bb-4fd7-9db0-24f3982fb123 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:22.825545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7bdc5720-14bb-4fd7-9db0-24f3982fb123 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:22.955342 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7bdc5720-14bb-4fd7-9db0-24f3982fb123 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:22.963183 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7bdc5720-14bb-4fd7-9db0-24f3982fb123 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:22.964709 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7bdc5720-14bb-4fd7-9db0-24f3982fb123 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:22.965800 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-7bdc5720-14bb-4fd7-9db0-24f3982fb123 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1407 microversion: 2.20 time: 0.154168 Aug 17 23:50:22.966352 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 436/894] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:22 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:50:23.727794 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e464ecd4-947b-4448-805c-6f1d758d6b17 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:23.728435 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e464ecd4-947b-4448-805c-6f1d758d6b17 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:23.730852 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=6 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:23.736110 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e464ecd4-947b-4448-805c-6f1d758d6b17 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:23.736597 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e464ecd4-947b-4448-805c-6f1d758d6b17 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:23.737036 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e464ecd4-947b-4448-805c-6f1d758d6b17 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:23.737721 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e464ecd4-947b-4448-805c-6f1d758d6b17 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:23.738185 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e464ecd4-947b-4448-805c-6f1d758d6b17 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:23.738607 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e464ecd4-947b-4448-805c-6f1d758d6b17 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:23.864500 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e464ecd4-947b-4448-805c-6f1d758d6b17 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:23.872464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e464ecd4-947b-4448-805c-6f1d758d6b17 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1687 microversion: 2.1 time: 0.148411 Aug 17 23:50:23.873026 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 459/895] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:23 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1687 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:23.988164 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-97bceac1-3c44-4f83-bd06-2594140586bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:23.988710 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-97bceac1-3c44-4f83-bd06-2594140586bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:23.990921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:23.991570 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=6 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:23.998663 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-97bceac1-3c44-4f83-bd06-2594140586bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:23.999147 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-97bceac1-3c44-4f83-bd06-2594140586bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:23.999585 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-97bceac1-3c44-4f83-bd06-2594140586bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:24.000327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-97bceac1-3c44-4f83-bd06-2594140586bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:24.000816 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-97bceac1-3c44-4f83-bd06-2594140586bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:24.001241 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-97bceac1-3c44-4f83-bd06-2594140586bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:24.129955 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-97bceac1-3c44-4f83-bd06-2594140586bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:24.138522 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-97bceac1-3c44-4f83-bd06-2594140586bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:24.140062 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-97bceac1-3c44-4f83-bd06-2594140586bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:24.141165 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-97bceac1-3c44-4f83-bd06-2594140586bd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1407 microversion: 2.20 time: 0.156950 Aug 17 23:50:24.141723 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 437/896] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:23 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:50:24.739439 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-209eeb29-499d-489e-a4f7-d42a25e32c34 req-f5c57604-6f73-43b5-b6fd-3700b6d30dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011c37dd-ede6-411d-b147-395b6e36ec9d", "name": "network-vif-plugged", "status": "completed", "tag": "1cf07451-1bbc-4e01-a03f-428d2ab9b4b7"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:50:24.750327 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-209eeb29-499d-489e-a4f7-d42a25e32c34 req-f5c57604-6f73-43b5-b6fd-3700b6d30dc1 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:24.750811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-209eeb29-499d-489e-a4f7-d42a25e32c34 req-f5c57604-6f73-43b5-b6fd-3700b6d30dc1 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:24.751244 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-209eeb29-499d-489e-a4f7-d42a25e32c34 req-f5c57604-6f73-43b5-b6fd-3700b6d30dc1 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:24.762928 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-209eeb29-499d-489e-a4f7-d42a25e32c34 req-f5c57604-6f73-43b5-b6fd-3700b6d30dc1 service nova] Creating event network-vif-plugged:1cf07451-1bbc-4e01-a03f-428d2ab9b4b7 for instance 011c37dd-ede6-411d-b147-395b6e36ec9d on hv-cinder-82002 Aug 17 23:50:24.768188 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-209eeb29-499d-489e-a4f7-d42a25e32c34 req-f5c57604-6f73-43b5-b6fd-3700b6d30dc1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032388 Aug 17 23:50:24.768781 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 460/897] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:24.892776 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5e850bd2-cb7b-441f-8f32-ca74f5862186 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:24.893399 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5e850bd2-cb7b-441f-8f32-ca74f5862186 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:24.899322 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5e850bd2-cb7b-441f-8f32-ca74f5862186 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:24.899811 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5e850bd2-cb7b-441f-8f32-ca74f5862186 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:24.900296 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5e850bd2-cb7b-441f-8f32-ca74f5862186 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:24.900991 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5e850bd2-cb7b-441f-8f32-ca74f5862186 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:24.901452 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5e850bd2-cb7b-441f-8f32-ca74f5862186 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:24.901881 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5e850bd2-cb7b-441f-8f32-ca74f5862186 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:25.029993 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5e850bd2-cb7b-441f-8f32-ca74f5862186 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:25.037754 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5e850bd2-cb7b-441f-8f32-ca74f5862186 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1687 microversion: 2.1 time: 0.148859 Aug 17 23:50:25.038352 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 438/898] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:24 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1687 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:25.165189 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-efb66986-60e8-4314-9e6b-5d1bd8dd1355 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:25.165893 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-efb66986-60e8-4314-9e6b-5d1bd8dd1355 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:25.171984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-efb66986-60e8-4314-9e6b-5d1bd8dd1355 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:25.172501 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-efb66986-60e8-4314-9e6b-5d1bd8dd1355 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:25.172941 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-efb66986-60e8-4314-9e6b-5d1bd8dd1355 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:25.173630 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-efb66986-60e8-4314-9e6b-5d1bd8dd1355 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:25.174107 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-efb66986-60e8-4314-9e6b-5d1bd8dd1355 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:25.174516 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-efb66986-60e8-4314-9e6b-5d1bd8dd1355 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:25.304003 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-efb66986-60e8-4314-9e6b-5d1bd8dd1355 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:25.312384 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-efb66986-60e8-4314-9e6b-5d1bd8dd1355 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:25.313888 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-efb66986-60e8-4314-9e6b-5d1bd8dd1355 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:25.314983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-efb66986-60e8-4314-9e6b-5d1bd8dd1355 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1407 microversion: 2.20 time: 0.154274 Aug 17 23:50:25.315546 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 461/899] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:25 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:50:26.059029 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ed62c06f-c3fe-460c-8b55-423a68f4dbd2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:26.059655 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ed62c06f-c3fe-460c-8b55-423a68f4dbd2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:26.066103 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ed62c06f-c3fe-460c-8b55-423a68f4dbd2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:26.066585 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ed62c06f-c3fe-460c-8b55-423a68f4dbd2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:26.067022 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ed62c06f-c3fe-460c-8b55-423a68f4dbd2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:26.067742 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ed62c06f-c3fe-460c-8b55-423a68f4dbd2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:26.068233 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ed62c06f-c3fe-460c-8b55-423a68f4dbd2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:26.068658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ed62c06f-c3fe-460c-8b55-423a68f4dbd2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:26.196301 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ed62c06f-c3fe-460c-8b55-423a68f4dbd2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:26.203916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ed62c06f-c3fe-460c-8b55-423a68f4dbd2 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1687 microversion: 2.1 time: 0.148722 Aug 17 23:50:26.204791 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 439/900] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:26 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1687 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:26.337824 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c8524083-5fc3-44a1-b8c9-d092eb765e4f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:26.338368 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c8524083-5fc3-44a1-b8c9-d092eb765e4f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:26.344990 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c8524083-5fc3-44a1-b8c9-d092eb765e4f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:26.345463 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c8524083-5fc3-44a1-b8c9-d092eb765e4f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:26.345890 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c8524083-5fc3-44a1-b8c9-d092eb765e4f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:26.346564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c8524083-5fc3-44a1-b8c9-d092eb765e4f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:26.347011 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c8524083-5fc3-44a1-b8c9-d092eb765e4f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:26.347425 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c8524083-5fc3-44a1-b8c9-d092eb765e4f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:26.477765 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c8524083-5fc3-44a1-b8c9-d092eb765e4f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:26.486143 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c8524083-5fc3-44a1-b8c9-d092eb765e4f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:26.487677 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c8524083-5fc3-44a1-b8c9-d092eb765e4f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:26.488843 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c8524083-5fc3-44a1-b8c9-d092eb765e4f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1407 microversion: 2.20 time: 0.154936 Aug 17 23:50:26.489397 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 462/901] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:26 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:50:27.225470 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-8a8cd7c6-d555-4f2a-889b-814ccd600efd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:27.226090 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-8a8cd7c6-d555-4f2a-889b-814ccd600efd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:27.233055 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7c6-d555-4f2a-889b-814ccd600efd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:27.233567 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7c6-d555-4f2a-889b-814ccd600efd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:27.234020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7c6-d555-4f2a-889b-814ccd600efd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:27.234741 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7c6-d555-4f2a-889b-814ccd600efd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:27.235254 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7c6-d555-4f2a-889b-814ccd600efd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:27.235685 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7c6-d555-4f2a-889b-814ccd600efd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:27.363291 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-8a8cd7c6-d555-4f2a-889b-814ccd600efd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:27.370661 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-8a8cd7c6-d555-4f2a-889b-814ccd600efd tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1687 microversion: 2.1 time: 0.149093 Aug 17 23:50:27.371813 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 440/902] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:27 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:27.511042 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e33c1a22-f094-4a71-9ffb-bf1824b05d84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:27.511574 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e33c1a22-f094-4a71-9ffb-bf1824b05d84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:27.518988 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e33c1a22-f094-4a71-9ffb-bf1824b05d84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:27.519481 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e33c1a22-f094-4a71-9ffb-bf1824b05d84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:27.519922 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e33c1a22-f094-4a71-9ffb-bf1824b05d84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:27.520637 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e33c1a22-f094-4a71-9ffb-bf1824b05d84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:27.521655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e33c1a22-f094-4a71-9ffb-bf1824b05d84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:27.522094 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e33c1a22-f094-4a71-9ffb-bf1824b05d84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:27.526699 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:27.655044 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e33c1a22-f094-4a71-9ffb-bf1824b05d84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:27.663389 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e33c1a22-f094-4a71-9ffb-bf1824b05d84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:27.664910 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e33c1a22-f094-4a71-9ffb-bf1824b05d84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:27.666008 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e33c1a22-f094-4a71-9ffb-bf1824b05d84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1407 microversion: 2.20 time: 0.158915 Aug 17 23:50:27.666562 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 463/903] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:27 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:50:28.392491 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-6dbed511-73cc-4f4e-aa22-42b1101c60c6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:28.393086 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-6dbed511-73cc-4f4e-aa22-42b1101c60c6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:28.399378 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6dbed511-73cc-4f4e-aa22-42b1101c60c6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:28.399864 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6dbed511-73cc-4f4e-aa22-42b1101c60c6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:28.400331 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6dbed511-73cc-4f4e-aa22-42b1101c60c6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:28.401023 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6dbed511-73cc-4f4e-aa22-42b1101c60c6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:28.401480 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6dbed511-73cc-4f4e-aa22-42b1101c60c6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:28.401902 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6dbed511-73cc-4f4e-aa22-42b1101c60c6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:28.535209 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-6dbed511-73cc-4f4e-aa22-42b1101c60c6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:28.543492 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-6dbed511-73cc-4f4e-aa22-42b1101c60c6 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1687 microversion: 2.1 time: 0.154802 Aug 17 23:50:28.544089 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 441/904] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:28 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:28.689408 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e64571ba-1095-4c97-921f-873944e5ca79 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:28.690099 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e64571ba-1095-4c97-921f-873944e5ca79 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:28.696809 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e64571ba-1095-4c97-921f-873944e5ca79 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:28.697289 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e64571ba-1095-4c97-921f-873944e5ca79 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:28.697724 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e64571ba-1095-4c97-921f-873944e5ca79 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:28.698410 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e64571ba-1095-4c97-921f-873944e5ca79 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:28.698876 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e64571ba-1095-4c97-921f-873944e5ca79 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:28.699283 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e64571ba-1095-4c97-921f-873944e5ca79 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:28.895416 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e64571ba-1095-4c97-921f-873944e5ca79 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:28.903412 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e64571ba-1095-4c97-921f-873944e5ca79 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:28.905123 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e64571ba-1095-4c97-921f-873944e5ca79 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:28.906318 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e64571ba-1095-4c97-921f-873944e5ca79 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1407 microversion: 2.20 time: 0.220811 Aug 17 23:50:28.906874 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 464/905] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:28 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:50:29.238351 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-e7259677-6a48-4006-a309-d7ebe7cb2fc5 req-a05237bb-1d09-4475-9937-05f7abaf460d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b73d6d-ce40-4adb-bbd2-7ac326eb758a", "name": "network-vif-deleted", "tag": "a7bb89fa-fcc0-415d-8ac1-70d1ad224517"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:50:29.249173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-e7259677-6a48-4006-a309-d7ebe7cb2fc5 req-a05237bb-1d09-4475-9937-05f7abaf460d service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:29.249628 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-e7259677-6a48-4006-a309-d7ebe7cb2fc5 req-a05237bb-1d09-4475-9937-05f7abaf460d service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:29.250278 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-e7259677-6a48-4006-a309-d7ebe7cb2fc5 req-a05237bb-1d09-4475-9937-05f7abaf460d service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:29.262230 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-e7259677-6a48-4006-a309-d7ebe7cb2fc5 req-a05237bb-1d09-4475-9937-05f7abaf460d service nova] Creating event network-vif-deleted:a7bb89fa-fcc0-415d-8ac1-70d1ad224517 for instance 20b73d6d-ce40-4adb-bbd2-7ac326eb758a on hv-cinder-82002 Aug 17 23:50:29.267217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-e7259677-6a48-4006-a309-d7ebe7cb2fc5 req-a05237bb-1d09-4475-9937-05f7abaf460d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032436 Aug 17 23:50:29.267816 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 442/906] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:29.332850 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-7512061e-a286-490c-ac49-220c8b238170 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:29.333263 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-7512061e-a286-490c-ac49-220c8b238170 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:29.339465 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7512061e-a286-490c-ac49-220c8b238170 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:29.340794 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7512061e-a286-490c-ac49-220c8b238170 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:29.341452 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7512061e-a286-490c-ac49-220c8b238170 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:29.342202 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7512061e-a286-490c-ac49-220c8b238170 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:29.342849 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7512061e-a286-490c-ac49-220c8b238170 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:29.343375 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7512061e-a286-490c-ac49-220c8b238170 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:29.370102 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-7512061e-a286-490c-ac49-220c8b238170 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Going to try to terminate instance {{(pid=131394) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:50:29.565491 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9615c8ba-4da4-44a9-9b43-07298a16fea7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:29.566331 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9615c8ba-4da4-44a9-9b43-07298a16fea7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:29.572464 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9615c8ba-4da4-44a9-9b43-07298a16fea7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:29.572951 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9615c8ba-4da4-44a9-9b43-07298a16fea7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:29.573386 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9615c8ba-4da4-44a9-9b43-07298a16fea7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:29.574080 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9615c8ba-4da4-44a9-9b43-07298a16fea7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:29.575075 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9615c8ba-4da4-44a9-9b43-07298a16fea7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:29.575499 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9615c8ba-4da4-44a9-9b43-07298a16fea7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:29.605279 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-7512061e-a286-490c-ac49-220c8b238170 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "DELETE /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 204 len: 0 microversion: 2.1 time: 0.276173 Aug 17 23:50:29.608973 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 465/907] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:50:29 2022] DELETE /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 23:50:29.609133 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9615c8ba-4da4-44a9-9b43-07298a16fea7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:29.609133 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9615c8ba-4da4-44a9-9b43-07298a16fea7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:29.609518 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9615c8ba-4da4-44a9-9b43-07298a16fea7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:29.609969 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.objects.instance [None req-9615c8ba-4da4-44a9-9b43-07298a16fea7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lazy-loading 'fault' on Instance uuid 20b73d6d-ce40-4adb-bbd2-7ac326eb758a {{(pid=131395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:50:29.614187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d2075841-fc6d-409e-8c0c-cc7a82f9837f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:29.615011 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d2075841-fc6d-409e-8c0c-cc7a82f9837f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:29.621932 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d2075841-fc6d-409e-8c0c-cc7a82f9837f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:29.622435 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d2075841-fc6d-409e-8c0c-cc7a82f9837f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:29.622881 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d2075841-fc6d-409e-8c0c-cc7a82f9837f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:29.623577 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d2075841-fc6d-409e-8c0c-cc7a82f9837f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:29.624216 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d2075841-fc6d-409e-8c0c-cc7a82f9837f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:29.624684 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d2075841-fc6d-409e-8c0c-cc7a82f9837f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:29.657580 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9615c8ba-4da4-44a9-9b43-07298a16fea7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:29.665859 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9615c8ba-4da4-44a9-9b43-07298a16fea7 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1335 microversion: 2.1 time: 0.104893 Aug 17 23:50:29.666801 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 443/908] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:29 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1335 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:29.766835 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d2075841-fc6d-409e-8c0c-cc7a82f9837f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:29.775537 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d2075841-fc6d-409e-8c0c-cc7a82f9837f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1579 microversion: 2.1 time: 0.165237 Aug 17 23:50:29.776129 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 466/909] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:29 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:50:29.929076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-51b69d19-aaa5-4a70-ac78-805b0e65abc9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:29.929721 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-51b69d19-aaa5-4a70-ac78-805b0e65abc9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:29.936163 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-51b69d19-aaa5-4a70-ac78-805b0e65abc9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:29.936654 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-51b69d19-aaa5-4a70-ac78-805b0e65abc9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:29.937089 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-51b69d19-aaa5-4a70-ac78-805b0e65abc9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:29.937777 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-51b69d19-aaa5-4a70-ac78-805b0e65abc9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:29.938230 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-51b69d19-aaa5-4a70-ac78-805b0e65abc9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:29.938653 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-51b69d19-aaa5-4a70-ac78-805b0e65abc9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:30.072173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-51b69d19-aaa5-4a70-ac78-805b0e65abc9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:30.081137 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-51b69d19-aaa5-4a70-ac78-805b0e65abc9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:30.082668 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-51b69d19-aaa5-4a70-ac78-805b0e65abc9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:30.083891 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-51b69d19-aaa5-4a70-ac78-805b0e65abc9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1598 microversion: 2.20 time: 0.158787 Aug 17 23:50:30.084487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 444/910] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:50:29 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:50:30.106313 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e17fa648-59c4-4fde-8eef-8f7403f2dcea tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:30.106604 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e17fa648-59c4-4fde-8eef-8f7403f2dcea tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:30.112805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e17fa648-59c4-4fde-8eef-8f7403f2dcea tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:30.113292 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e17fa648-59c4-4fde-8eef-8f7403f2dcea tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:30.113729 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e17fa648-59c4-4fde-8eef-8f7403f2dcea tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:30.114426 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e17fa648-59c4-4fde-8eef-8f7403f2dcea tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:30.114878 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e17fa648-59c4-4fde-8eef-8f7403f2dcea tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:30.115300 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e17fa648-59c4-4fde-8eef-8f7403f2dcea tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:30.194714 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e17fa648-59c4-4fde-8eef-8f7403f2dcea tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092579 Aug 17 23:50:30.195300 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 467/911] 10.222.0.26 () {60 vars in 1316 bytes} [Wed Aug 17 23:50:30 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 23:50:30.686961 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a8e1a913-d6bb-49de-997e-7b68f392c66a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:30.687575 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a8e1a913-d6bb-49de-997e-7b68f392c66a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:30.694126 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a8e1a913-d6bb-49de-997e-7b68f392c66a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:30.694611 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a8e1a913-d6bb-49de-997e-7b68f392c66a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:30.695114 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a8e1a913-d6bb-49de-997e-7b68f392c66a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:30.695823 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a8e1a913-d6bb-49de-997e-7b68f392c66a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:30.696308 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a8e1a913-d6bb-49de-997e-7b68f392c66a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:30.696735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a8e1a913-d6bb-49de-997e-7b68f392c66a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:30.728658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a8e1a913-d6bb-49de-997e-7b68f392c66a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:30.729144 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a8e1a913-d6bb-49de-997e-7b68f392c66a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:30.729581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a8e1a913-d6bb-49de-997e-7b68f392c66a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:30.730029 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.objects.instance [None req-a8e1a913-d6bb-49de-997e-7b68f392c66a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lazy-loading 'fault' on Instance uuid 20b73d6d-ce40-4adb-bbd2-7ac326eb758a {{(pid=131395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:50:30.774213 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a8e1a913-d6bb-49de-997e-7b68f392c66a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:30.781705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a8e1a913-d6bb-49de-997e-7b68f392c66a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 200 len: 1335 microversion: 2.1 time: 0.099034 Aug 17 23:50:30.782274 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 445/912] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:30 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 1335 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:50:30.798685 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-5f6a7c2e-d759-465c-b52f-d24823801610 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:30.799304 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-5f6a7c2e-d759-465c-b52f-d24823801610 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:30.805448 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5f6a7c2e-d759-465c-b52f-d24823801610 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:30.805939 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5f6a7c2e-d759-465c-b52f-d24823801610 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:30.806378 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5f6a7c2e-d759-465c-b52f-d24823801610 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:30.807078 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5f6a7c2e-d759-465c-b52f-d24823801610 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:30.807568 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5f6a7c2e-d759-465c-b52f-d24823801610 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:30.808081 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5f6a7c2e-d759-465c-b52f-d24823801610 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:31.033069 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5f6a7c2e-d759-465c-b52f-d24823801610 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:31.040837 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-5f6a7c2e-d759-465c-b52f-d24823801610 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1579 microversion: 2.1 time: 0.246554 Aug 17 23:50:31.041738 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 468/913] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:30 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1579 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:31.284121 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-d41596d4-ae33-4fde-b2d5-97a7ce827d16 req-8328d108-8260-4492-beed-a9c1d1892d4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "011c37dd-ede6-411d-b147-395b6e36ec9d", "tag": "1cf07451-1bbc-4e01-a03f-428d2ab9b4b7"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:50:31.292239 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:31.296919 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-d41596d4-ae33-4fde-b2d5-97a7ce827d16 req-8328d108-8260-4492-beed-a9c1d1892d4b service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:31.297442 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-d41596d4-ae33-4fde-b2d5-97a7ce827d16 req-8328d108-8260-4492-beed-a9c1d1892d4b service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:31.297880 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-d41596d4-ae33-4fde-b2d5-97a7ce827d16 req-8328d108-8260-4492-beed-a9c1d1892d4b service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:31.310112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-d41596d4-ae33-4fde-b2d5-97a7ce827d16 req-8328d108-8260-4492-beed-a9c1d1892d4b service nova] Creating event network-changed:1cf07451-1bbc-4e01-a03f-428d2ab9b4b7 for instance 011c37dd-ede6-411d-b147-395b6e36ec9d on hv-cinder-82002 Aug 17 23:50:31.315358 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-d41596d4-ae33-4fde-b2d5-97a7ce827d16 req-8328d108-8260-4492-beed-a9c1d1892d4b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035381 Aug 17 23:50:31.315948 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 446/914] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:31.802310 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-32b31dca-9cb4-4965-b6e1-a43450457630 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:31.802906 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-32b31dca-9cb4-4965-b6e1-a43450457630 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 20b73d6d-ce40-4adb-bbd2-7ac326eb758a] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:31.809323 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-32b31dca-9cb4-4965-b6e1-a43450457630 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:31.809815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-32b31dca-9cb4-4965-b6e1-a43450457630 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:31.810255 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-32b31dca-9cb4-4965-b6e1-a43450457630 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:31.810951 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-32b31dca-9cb4-4965-b6e1-a43450457630 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:31.811409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-32b31dca-9cb4-4965-b6e1-a43450457630 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:31.811835 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-32b31dca-9cb4-4965-b6e1-a43450457630 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:31.824833 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-32b31dca-9cb4-4965-b6e1-a43450457630 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] HTTP exception thrown: Instance 20b73d6d-ce40-4adb-bbd2-7ac326eb758a could not be found. Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-32b31dca-9cb4-4965-b6e1-a43450457630 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Request method failure captured: Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a HTTP/1.1 Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X0diO02GDVsees0ow7IkXKzIuul6QEmJ2Nv7i9HfBPD7e2j-jzLKTFcjJ8KBABEjBcsMQiTuyNcmjGYaRHOtX6NetLnvMesRTx1pmEyyYO3llMGBjIGxbDgoTaetHgZcL5KAnV1LdBDF1RGbkUDkZ3WWB_pyjiCJNMMeOwgFJjlQuk Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: dbc0fe79b67f4446b1a4c36c068f9b00 Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1988082284 Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:50:31.827019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:50:31.828606 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dbc0fe79b67f4446b1a4c36c068f9b00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dbc0fe79b67f4446b1a4c36c068f9b00", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dbc0fe79b67f4446b1a4c36c068f9b00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dbc0fe79b67f4446b1a4c36c068f9b00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:50:31.828606 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1988082284 Aug 17 23:50:31.828606 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: dbc0fe79b67f4446b1a4c36c068f9b00 Aug 17 23:50:31.828606 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1988082284 Aug 17 23:50:31.828606 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-ServerRescueNegativeTestJSON-1988082284-project Aug 17 23:50:31.828606 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:50:31.828606 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:50:31.828606 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: c67dec924b7e4f0aa0874e6e21879889 Aug 17 23:50:31.828606 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1988082284-project Aug 17 23:50:31.828606 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:50:31.828606 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance 20b73d6d-ce40-4adb-bbd2-7ac326eb758a could not be found. Aug 17 23:50:31.828606 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': '20b73d6d-ce40-4adb-bbd2-7ac326eb758a'} Aug 17 23:50:31.829434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:50:31.829434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:50:31.829434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:50:31.829434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:50:31.829434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:50:31.829434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:50:31.829434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:50:31.829434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:50:31.829434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:50:31.829434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:50:31.829434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20b73d6d-ce40-4adb-bbd2-7ac326eb758a could not be found. Aug 17 23:50:31.829434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:50:31.829434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:50:31.829434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:50:31.829434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:50:31.829434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:50:31.829434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:50:31.829434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:50:31.829434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:50:31.829434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:50:31.830645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:50:31.830645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:50:31.830645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:50:31.830645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:50:31.830645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:50:31.830645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:50:31.830645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:50:31.830645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20b73d6d-ce40-4adb-bbd2-7ac326eb758a could not be found. Aug 17 23:50:31.830645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:50:31.830645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:50:31.830645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:50:31.830645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:50:31.830645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:50:31.830645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:50:31.830645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:50:31.830645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:50:31.830645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20b73d6d-ce40-4adb-bbd2-7ac326eb758a could not be found. Aug 17 23:50:31.830645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:50:31.831702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-32b31dca-9cb4-4965-b6e1-a43450457630 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Returning 404 to user: Instance 20b73d6d-ce40-4adb-bbd2-7ac326eb758a could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:50:31.831702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-32b31dca-9cb4-4965-b6e1-a43450457630 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a" status: 404 len: 111 microversion: 2.1 time: 0.030031 Aug 17 23:50:31.831702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 469/915] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:31 2022] GET /compute/v2.1/servers/20b73d6d-ce40-4adb-bbd2-7ac326eb758a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:50:31.838159 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-d928de37-654f-4b00-bb45-86c8bcc95f0a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '.version_select at 0x7f8601fc6ca0>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:31.859623 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-d928de37-654f-4b00-bb45-86c8bcc95f0a tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-813049522" status: 202 len: 0 microversion: 2.1 time: 0.026135 Aug 17 23:50:31.860385 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 447/916] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Aug 17 23:50:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-813049522 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:50:32.063302 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1dc53b41-79c1-4cf0-9444-77a2581bfc2e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:32.064033 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1dc53b41-79c1-4cf0-9444-77a2581bfc2e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:32.070223 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1dc53b41-79c1-4cf0-9444-77a2581bfc2e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:32.071155 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1dc53b41-79c1-4cf0-9444-77a2581bfc2e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:32.071807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1dc53b41-79c1-4cf0-9444-77a2581bfc2e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:32.072743 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1dc53b41-79c1-4cf0-9444-77a2581bfc2e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:32.073399 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1dc53b41-79c1-4cf0-9444-77a2581bfc2e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:32.074017 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1dc53b41-79c1-4cf0-9444-77a2581bfc2e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:32.479956 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1dc53b41-79c1-4cf0-9444-77a2581bfc2e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:32.494280 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1dc53b41-79c1-4cf0-9444-77a2581bfc2e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1579 microversion: 2.1 time: 0.434848 Aug 17 23:50:32.500571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 470/917] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:32 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1579 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:33.341690 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-68f31e17-411d-417b-a56f-23ac3fcf2f8f req-dfc2360b-f1e1-4ac6-a87e-8ace154ccfa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12c673bc-cdc2-486b-a556-c6ce9a3fdb6c", "name": "network-vif-deleted", "tag": "353d5d74-5ab4-43f3-b3ae-b06325dafe66"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:50:33.353898 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-68f31e17-411d-417b-a56f-23ac3fcf2f8f req-dfc2360b-f1e1-4ac6-a87e-8ace154ccfa9 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:33.354380 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-68f31e17-411d-417b-a56f-23ac3fcf2f8f req-dfc2360b-f1e1-4ac6-a87e-8ace154ccfa9 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:33.354817 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-68f31e17-411d-417b-a56f-23ac3fcf2f8f req-dfc2360b-f1e1-4ac6-a87e-8ace154ccfa9 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:33.367920 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-68f31e17-411d-417b-a56f-23ac3fcf2f8f req-dfc2360b-f1e1-4ac6-a87e-8ace154ccfa9 service nova] Creating event network-vif-deleted:353d5d74-5ab4-43f3-b3ae-b06325dafe66 for instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c on hv-cinder-82002 Aug 17 23:50:33.374285 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-68f31e17-411d-417b-a56f-23ac3fcf2f8f req-dfc2360b-f1e1-4ac6-a87e-8ace154ccfa9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037058 Aug 17 23:50:33.379304 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 448/918] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:33.517109 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-484b9103-3538-4a81-98ba-bf78239574f2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:33.517729 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-484b9103-3538-4a81-98ba-bf78239574f2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:33.524400 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-484b9103-3538-4a81-98ba-bf78239574f2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:33.525184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-484b9103-3538-4a81-98ba-bf78239574f2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:33.525652 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-484b9103-3538-4a81-98ba-bf78239574f2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:33.526345 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-484b9103-3538-4a81-98ba-bf78239574f2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:33.526796 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-484b9103-3538-4a81-98ba-bf78239574f2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:33.527216 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-484b9103-3538-4a81-98ba-bf78239574f2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:33.588978 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-484b9103-3538-4a81-98ba-bf78239574f2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:33.596548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-484b9103-3538-4a81-98ba-bf78239574f2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 200 len: 1225 microversion: 2.1 time: 0.084166 Aug 17 23:50:33.597106 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 471/919] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:33 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:34.617978 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ab2f86ac-f03e-4722-9525-d39a4eff96e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:34.618584 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ab2f86ac-f03e-4722-9525-d39a4eff96e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:34.624721 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ab2f86ac-f03e-4722-9525-d39a4eff96e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:34.625207 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ab2f86ac-f03e-4722-9525-d39a4eff96e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:34.625644 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ab2f86ac-f03e-4722-9525-d39a4eff96e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:34.626335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ab2f86ac-f03e-4722-9525-d39a4eff96e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:34.626789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ab2f86ac-f03e-4722-9525-d39a4eff96e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:34.627212 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ab2f86ac-f03e-4722-9525-d39a4eff96e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:34.640957 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-ab2f86ac-f03e-4722-9525-d39a4eff96e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] HTTP exception thrown: Instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c could not be found. Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ab2f86ac-f03e-4722-9525-d39a4eff96e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Request method failure captured: Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c HTTP/1.1 Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X3JNTkBR_1fT2tMSpUeTq-DFYXuXK-7PKWdV4z9Bsts0hKYvjsvem6yw6YRaUqTDww7UqGc_MyO6lNGeWvvX9rgBgI55iCF52dr4WU7s-8UHluHWlrluJ7vRe26698gsiPg6-jdwjR2avi2BMiX8eKZh78xWYeDNUYZY7JROO3nEBo Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: 8e81ed7b06f84b2bab3369334cb1f90a Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-TestVolumeBootPattern-2116673975 Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:50:34.642546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:50:34.644063 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8e81ed7b06f84b2bab3369334cb1f90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8e81ed7b06f84b2bab3369334cb1f90a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e81ed7b06f84b2bab3369334cb1f90a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e81ed7b06f84b2bab3369334cb1f90a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:50:34.644063 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-TestVolumeBootPattern-2116673975 Aug 17 23:50:34.644063 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: 8e81ed7b06f84b2bab3369334cb1f90a Aug 17 23:50:34.644063 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116673975 Aug 17 23:50:34.644063 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-TestVolumeBootPattern-2116673975-project Aug 17 23:50:34.644063 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:50:34.644063 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:50:34.644063 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: cf6e346e96144628ac25c428be38870a Aug 17 23:50:34.644063 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-TestVolumeBootPattern-2116673975-project Aug 17 23:50:34.644063 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:50:34.644063 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c could not be found. Aug 17 23:50:34.644063 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': '12c673bc-cdc2-486b-a556-c6ce9a3fdb6c'} Aug 17 23:50:34.644900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:50:34.644900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:50:34.644900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:50:34.644900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:50:34.644900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:50:34.644900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:50:34.644900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:50:34.644900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:50:34.644900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:50:34.644900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:50:34.644900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c could not be found. Aug 17 23:50:34.644900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:50:34.644900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:50:34.644900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:50:34.644900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:50:34.644900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:50:34.644900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:50:34.644900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:50:34.644900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:50:34.644900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:50:34.646069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:50:34.646069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:50:34.646069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:50:34.646069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:50:34.646069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:50:34.646069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:50:34.646069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:50:34.646069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c could not be found. Aug 17 23:50:34.646069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:50:34.646069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:50:34.646069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:50:34.646069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:50:34.646069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:50:34.646069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:50:34.646069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:50:34.646069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:50:34.646069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c could not be found. Aug 17 23:50:34.646069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:50:34.647136 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ab2f86ac-f03e-4722-9525-d39a4eff96e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Returning 404 to user: Instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:50:34.647136 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ab2f86ac-f03e-4722-9525-d39a4eff96e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 404 len: 111 microversion: 2.1 time: 0.030807 Aug 17 23:50:34.647136 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 449/920] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:34 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:50:34.691655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-907feeb0-5858-4fd5-8c51-b72f47f02482 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-795626941", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1844905335", "security_groups": [{"name": "tempest-secgroup-smoke-1359277404"}], "block_device_mapping_v2": [{"uuid": "31497b97-ffe0-43b7-8d71-acf42411be81", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "767a2b34-2391-4975-a5de-d7b63e2cf978"}]}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:50:34.813512 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.network.neutron [None req-907feeb0-5858-4fd5-8c51-b72f47f02482 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] validate_networks() for [('767a2b34-2391-4975-a5de-d7b63e2cf978', None, None, None, None, None)] {{(pid=131394) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:50:35.168437 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ccc2a063-6aa9-46da-872e-1f985f57491f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:35.169001 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ccc2a063-6aa9-46da-872e-1f985f57491f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:35.174823 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccc2a063-6aa9-46da-872e-1f985f57491f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:35.175302 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccc2a063-6aa9-46da-872e-1f985f57491f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:35.175735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccc2a063-6aa9-46da-872e-1f985f57491f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:35.176474 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccc2a063-6aa9-46da-872e-1f985f57491f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:35.176927 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccc2a063-6aa9-46da-872e-1f985f57491f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:35.177347 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ccc2a063-6aa9-46da-872e-1f985f57491f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:35.204632 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ccc2a063-6aa9-46da-872e-1f985f57491f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Going to try to terminate instance {{(pid=131395) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:50:35.230780 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:35.242991 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-907feeb0-5858-4fd5-8c51-b72f47f02482 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Flavor limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:50:35.243774 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-907feeb0-5858-4fd5-8c51-b72f47f02482 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Image limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:50:35.244411 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-907feeb0-5858-4fd5-8c51-b72f47f02482 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Flavor pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:50:35.244833 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-907feeb0-5858-4fd5-8c51-b72f47f02482 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Image pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:50:35.245253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-907feeb0-5858-4fd5-8c51-b72f47f02482 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:50:35.254452 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-907feeb0-5858-4fd5-8c51-b72f47f02482 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:35.254941 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-907feeb0-5858-4fd5-8c51-b72f47f02482 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:35.255377 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-907feeb0-5858-4fd5-8c51-b72f47f02482 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:35.256297 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-907feeb0-5858-4fd5-8c51-b72f47f02482 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:35.256761 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-907feeb0-5858-4fd5-8c51-b72f47f02482 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:35.257403 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-907feeb0-5858-4fd5-8c51-b72f47f02482 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:35.275506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-907feeb0-5858-4fd5-8c51-b72f47f02482 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Getting quotas for project 8e81ed7b06f84b2bab3369334cb1f90a. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:50:35.280622 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-907feeb0-5858-4fd5-8c51-b72f47f02482 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Getting quotas for user cf6e346e96144628ac25c428be38870a and project 8e81ed7b06f84b2bab3369334cb1f90a. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:50:35.282860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ccc2a063-6aa9-46da-872e-1f985f57491f tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 204 len: 0 microversion: 2.1 time: 0.118290 Aug 17 23:50:35.283513 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 450/921] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:50:35 2022] DELETE /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 23:50:35.292488 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0cb86810-9515-4af5-8262-1a4811970721 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:35.293188 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0cb86810-9515-4af5-8262-1a4811970721 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:35.298918 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0cb86810-9515-4af5-8262-1a4811970721 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:35.299491 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0cb86810-9515-4af5-8262-1a4811970721 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:35.299931 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0cb86810-9515-4af5-8262-1a4811970721 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:35.300649 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0cb86810-9515-4af5-8262-1a4811970721 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:35.301302 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0cb86810-9515-4af5-8262-1a4811970721 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:35.301519 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0cb86810-9515-4af5-8262-1a4811970721 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:35.342288 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-907feeb0-5858-4fd5-8c51-b72f47f02482 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Going to run 1 instances... {{(pid=131394) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:50:35.344551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-907feeb0-5858-4fd5-8c51-b72f47f02482 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='31497b97-ffe0-43b7-8d71-acf42411be81',volume_size=None,volume_type=None)] {{(pid=131394) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:50:35.437120 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:35.438910 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0cb86810-9515-4af5-8262-1a4811970721 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:35.448061 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0cb86810-9515-4af5-8262-1a4811970721 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1509 microversion: 2.1 time: 0.159146 Aug 17 23:50:35.448524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 451/922] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:35 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:50:35.485232 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-907feeb0-5858-4fd5-8c51-b72f47f02482 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.797275 Aug 17 23:50:35.486051 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 472/923] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 17 23:50:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 23:50:35.496684 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b7f7a2dd-4125-49f0-a15a-12309e0c7476 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:35.497931 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b7f7a2dd-4125-49f0-a15a-12309e0c7476 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:35.551210 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b7f7a2dd-4125-49f0-a15a-12309e0c7476 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:35.557825 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b7f7a2dd-4125-49f0-a15a-12309e0c7476 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1094 microversion: 2.1 time: 0.064873 Aug 17 23:50:35.558390 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 452/924] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:35 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:36.469098 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-23962463-cefd-4f1f-9ce4-4c4024952ae5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:36.469709 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-23962463-cefd-4f1f-9ce4-4c4024952ae5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:36.479701 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-23962463-cefd-4f1f-9ce4-4c4024952ae5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:36.480221 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-23962463-cefd-4f1f-9ce4-4c4024952ae5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:36.480929 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-23962463-cefd-4f1f-9ce4-4c4024952ae5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:36.481902 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-23962463-cefd-4f1f-9ce4-4c4024952ae5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:36.482107 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-23962463-cefd-4f1f-9ce4-4c4024952ae5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:36.482708 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-23962463-cefd-4f1f-9ce4-4c4024952ae5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:36.579671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-422eaa1c-ca04-4427-8ae1-e7f3ba9608be tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:36.580348 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-422eaa1c-ca04-4427-8ae1-e7f3ba9608be tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:36.587607 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-422eaa1c-ca04-4427-8ae1-e7f3ba9608be tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:36.588160 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-422eaa1c-ca04-4427-8ae1-e7f3ba9608be tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:36.588603 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-422eaa1c-ca04-4427-8ae1-e7f3ba9608be tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:36.589314 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-422eaa1c-ca04-4427-8ae1-e7f3ba9608be tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:36.589967 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-422eaa1c-ca04-4427-8ae1-e7f3ba9608be tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:36.590396 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-422eaa1c-ca04-4427-8ae1-e7f3ba9608be tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:36.676606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-422eaa1c-ca04-4427-8ae1-e7f3ba9608be tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:36.688694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-422eaa1c-ca04-4427-8ae1-e7f3ba9608be tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1192 microversion: 2.1 time: 0.113229 Aug 17 23:50:36.691586 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 453/925] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:36 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1192 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:36.852954 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-23962463-cefd-4f1f-9ce4-4c4024952ae5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:36.854411 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-001f8605-06ff-4cbd-b2ce-74c76d201b31 req-f649867f-95f7-47e4-8e51-ca35acef0e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c46dee0-bdd3-468a-ad6d-52a9f50e8210", "name": "network-vif-deleted", "tag": "021b5852-09eb-4120-9100-b585b3d1065b"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:50:36.863356 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-23962463-cefd-4f1f-9ce4-4c4024952ae5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 200 len: 1509 microversion: 2.1 time: 0.398383 Aug 17 23:50:36.864137 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-001f8605-06ff-4cbd-b2ce-74c76d201b31 req-f649867f-95f7-47e4-8e51-ca35acef0e23 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:36.864584 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-001f8605-06ff-4cbd-b2ce-74c76d201b31 req-f649867f-95f7-47e4-8e51-ca35acef0e23 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:36.865022 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-001f8605-06ff-4cbd-b2ce-74c76d201b31 req-f649867f-95f7-47e4-8e51-ca35acef0e23 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:36.878098 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-001f8605-06ff-4cbd-b2ce-74c76d201b31 req-f649867f-95f7-47e4-8e51-ca35acef0e23 service nova] Creating event network-vif-deleted:021b5852-09eb-4120-9100-b585b3d1065b for instance 8c46dee0-bdd3-468a-ad6d-52a9f50e8210 on hv-cinder-82002 Aug 17 23:50:36.880717 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 473/926] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:36 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 1509 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:50:36.883685 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-001f8605-06ff-4cbd-b2ce-74c76d201b31 req-f649867f-95f7-47e4-8e51-ca35acef0e23 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032815 Aug 17 23:50:36.884404 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 454/927] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:50:37.712609 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e868cfef-fc66-4a9f-bf14-9299cb3b63ef tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:37.713226 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e868cfef-fc66-4a9f-bf14-9299cb3b63ef tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:37.720221 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e868cfef-fc66-4a9f-bf14-9299cb3b63ef tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:37.720711 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e868cfef-fc66-4a9f-bf14-9299cb3b63ef tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:37.721148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e868cfef-fc66-4a9f-bf14-9299cb3b63ef tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:37.721836 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e868cfef-fc66-4a9f-bf14-9299cb3b63ef tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:37.722284 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e868cfef-fc66-4a9f-bf14-9299cb3b63ef tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:37.722707 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e868cfef-fc66-4a9f-bf14-9299cb3b63ef tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:37.785538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e868cfef-fc66-4a9f-bf14-9299cb3b63ef tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:37.794330 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e868cfef-fc66-4a9f-bf14-9299cb3b63ef tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1210 microversion: 2.1 time: 0.085661 Aug 17 23:50:37.795216 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 474/928] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:37 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:37.889207 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3d182ce2-eab5-471b-b98f-0edbc7097ecc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:37.890003 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3d182ce2-eab5-471b-b98f-0edbc7097ecc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: 8c46dee0-bdd3-468a-ad6d-52a9f50e8210] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:37.896076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3d182ce2-eab5-471b-b98f-0edbc7097ecc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:37.896654 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3d182ce2-eab5-471b-b98f-0edbc7097ecc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:37.897158 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3d182ce2-eab5-471b-b98f-0edbc7097ecc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:37.897918 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3d182ce2-eab5-471b-b98f-0edbc7097ecc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:37.898441 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3d182ce2-eab5-471b-b98f-0edbc7097ecc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:37.898928 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3d182ce2-eab5-471b-b98f-0edbc7097ecc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:37.913381 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-3d182ce2-eab5-471b-b98f-0edbc7097ecc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] HTTP exception thrown: Instance 8c46dee0-bdd3-468a-ad6d-52a9f50e8210 could not be found. Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3d182ce2-eab5-471b-b98f-0edbc7097ecc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Request method failure captured: Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 HTTP/1.1 Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X0diO02GDVsees0ow7IkXKzIuul6QEmJ2Nv7i9HfBPD7e2j-jzLKTFcjJ8KBABEjBcsMQiTuyNcmjGYaRHOtX6NetLnvMesRTx1pmEyyYO3llMGBjIGxbDgoTaetHgZcL5KAnV1LdBDF1RGbkUDkZ3WWB_pyjiCJNMMeOwgFJjlQuk Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: dbc0fe79b67f4446b1a4c36c068f9b00 Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1988082284 Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:50:37.915020 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:50:37.916787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dbc0fe79b67f4446b1a4c36c068f9b00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dbc0fe79b67f4446b1a4c36c068f9b00", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dbc0fe79b67f4446b1a4c36c068f9b00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dbc0fe79b67f4446b1a4c36c068f9b00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:50:37.916787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1988082284 Aug 17 23:50:37.916787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: dbc0fe79b67f4446b1a4c36c068f9b00 Aug 17 23:50:37.916787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1988082284 Aug 17 23:50:37.916787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-ServerRescueNegativeTestJSON-1988082284-project Aug 17 23:50:37.916787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:50:37.916787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:50:37.916787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: c67dec924b7e4f0aa0874e6e21879889 Aug 17 23:50:37.916787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1988082284-project Aug 17 23:50:37.916787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:50:37.916787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance 8c46dee0-bdd3-468a-ad6d-52a9f50e8210 could not be found. Aug 17 23:50:37.916787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': '8c46dee0-bdd3-468a-ad6d-52a9f50e8210'} Aug 17 23:50:37.917545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:50:37.917545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:50:37.917545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:50:37.917545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:50:37.917545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:50:37.917545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:50:37.917545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:50:37.917545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:50:37.917545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:50:37.917545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:50:37.917545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c46dee0-bdd3-468a-ad6d-52a9f50e8210 could not be found. Aug 17 23:50:37.917545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:50:37.917545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:50:37.917545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:50:37.917545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:50:37.917545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:50:37.917545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:50:37.917545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:50:37.917545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:50:37.917545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:50:37.918808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:50:37.918808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:50:37.918808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:50:37.918808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:50:37.918808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:50:37.918808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:50:37.918808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:50:37.918808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c46dee0-bdd3-468a-ad6d-52a9f50e8210 could not be found. Aug 17 23:50:37.918808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:50:37.918808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:50:37.918808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:50:37.918808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:50:37.918808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:50:37.918808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:50:37.918808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:50:37.918808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:50:37.918808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c46dee0-bdd3-468a-ad6d-52a9f50e8210 could not be found. Aug 17 23:50:37.918808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:50:37.919861 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3d182ce2-eab5-471b-b98f-0edbc7097ecc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Returning 404 to user: Instance 8c46dee0-bdd3-468a-ad6d-52a9f50e8210 could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:50:37.919861 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3d182ce2-eab5-471b-b98f-0edbc7097ecc tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210" status: 404 len: 111 microversion: 2.1 time: 0.032496 Aug 17 23:50:37.919861 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 455/929] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:37 2022] GET /compute/v2.1/servers/8c46dee0-bdd3-468a-ad6d-52a9f50e8210 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:50:37.925551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1ef3011f-746a-4927-af43-2d8496ebd70b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:37.926143 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1ef3011f-746a-4927-af43-2d8496ebd70b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:37.932341 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1ef3011f-746a-4927-af43-2d8496ebd70b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:37.932908 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1ef3011f-746a-4927-af43-2d8496ebd70b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:37.933417 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1ef3011f-746a-4927-af43-2d8496ebd70b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:37.934178 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1ef3011f-746a-4927-af43-2d8496ebd70b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:37.934709 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1ef3011f-746a-4927-af43-2d8496ebd70b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:37.935207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1ef3011f-746a-4927-af43-2d8496ebd70b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:37.963158 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1ef3011f-746a-4927-af43-2d8496ebd70b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Going to try to terminate instance {{(pid=131394) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:50:38.040631 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1ef3011f-746a-4927-af43-2d8496ebd70b tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 204 len: 0 microversion: 2.1 time: 0.118432 Aug 17 23:50:38.042171 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 475/930] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:50:37 2022] DELETE /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 23:50:38.051160 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-feb4ba2f-7765-4a29-917e-e272fa5a1a4c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:38.052109 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-feb4ba2f-7765-4a29-917e-e272fa5a1a4c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:38.058711 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-feb4ba2f-7765-4a29-917e-e272fa5a1a4c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:38.059264 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-feb4ba2f-7765-4a29-917e-e272fa5a1a4c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:38.060451 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-feb4ba2f-7765-4a29-917e-e272fa5a1a4c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:38.061151 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-feb4ba2f-7765-4a29-917e-e272fa5a1a4c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:38.061609 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-feb4ba2f-7765-4a29-917e-e272fa5a1a4c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:38.062031 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-feb4ba2f-7765-4a29-917e-e272fa5a1a4c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:38.219495 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-feb4ba2f-7765-4a29-917e-e272fa5a1a4c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:38.227470 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-feb4ba2f-7765-4a29-917e-e272fa5a1a4c tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1522 microversion: 2.1 time: 0.180466 Aug 17 23:50:38.228805 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 456/931] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:38 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:38.816972 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-51b2e769-010a-4ed4-ba0a-18cfffccc764 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:38.817671 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-51b2e769-010a-4ed4-ba0a-18cfffccc764 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:38.824095 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-51b2e769-010a-4ed4-ba0a-18cfffccc764 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:38.824580 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-51b2e769-010a-4ed4-ba0a-18cfffccc764 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:38.825019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-51b2e769-010a-4ed4-ba0a-18cfffccc764 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:38.825704 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-51b2e769-010a-4ed4-ba0a-18cfffccc764 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:38.826158 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-51b2e769-010a-4ed4-ba0a-18cfffccc764 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:38.826585 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-51b2e769-010a-4ed4-ba0a-18cfffccc764 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:38.958341 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-51b2e769-010a-4ed4-ba0a-18cfffccc764 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:38.966285 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-51b2e769-010a-4ed4-ba0a-18cfffccc764 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1278 microversion: 2.1 time: 0.153106 Aug 17 23:50:38.969116 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 476/932] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:38 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:39.248135 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-7b62befc-d583-4bf6-ad57-0983a7b9b1c5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:39.248754 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-7b62befc-d583-4bf6-ad57-0983a7b9b1c5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:39.255286 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7b62befc-d583-4bf6-ad57-0983a7b9b1c5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:39.255774 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7b62befc-d583-4bf6-ad57-0983a7b9b1c5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:39.256248 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7b62befc-d583-4bf6-ad57-0983a7b9b1c5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:39.256944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7b62befc-d583-4bf6-ad57-0983a7b9b1c5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:39.257437 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7b62befc-d583-4bf6-ad57-0983a7b9b1c5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:39.257862 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7b62befc-d583-4bf6-ad57-0983a7b9b1c5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:39.391743 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7b62befc-d583-4bf6-ad57-0983a7b9b1c5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:39.399418 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-7b62befc-d583-4bf6-ad57-0983a7b9b1c5 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1522 microversion: 2.1 time: 0.155152 Aug 17 23:50:39.399997 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 457/933] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:39 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:39.988591 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b7ca772b-611a-4eda-b096-9c38a46da09e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:39.989190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b7ca772b-611a-4eda-b096-9c38a46da09e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:39.995667 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b7ca772b-611a-4eda-b096-9c38a46da09e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:39.996196 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b7ca772b-611a-4eda-b096-9c38a46da09e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:39.996640 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b7ca772b-611a-4eda-b096-9c38a46da09e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:39.997925 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b7ca772b-611a-4eda-b096-9c38a46da09e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:39.998386 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b7ca772b-611a-4eda-b096-9c38a46da09e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:39.998814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b7ca772b-611a-4eda-b096-9c38a46da09e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:40.128075 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b7ca772b-611a-4eda-b096-9c38a46da09e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:40.135591 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b7ca772b-611a-4eda-b096-9c38a46da09e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1278 microversion: 2.1 time: 0.151120 Aug 17 23:50:40.136181 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 477/934] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:39 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:40.421685 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0fbec4bc-fbc4-47a1-a7d7-8a72d8e06332 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:40.422302 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0fbec4bc-fbc4-47a1-a7d7-8a72d8e06332 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:40.429987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0fbec4bc-fbc4-47a1-a7d7-8a72d8e06332 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:40.430580 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0fbec4bc-fbc4-47a1-a7d7-8a72d8e06332 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:40.431253 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0fbec4bc-fbc4-47a1-a7d7-8a72d8e06332 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:40.432197 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0fbec4bc-fbc4-47a1-a7d7-8a72d8e06332 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:40.432695 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0fbec4bc-fbc4-47a1-a7d7-8a72d8e06332 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:40.433330 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0fbec4bc-fbc4-47a1-a7d7-8a72d8e06332 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:40.931422 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0fbec4bc-fbc4-47a1-a7d7-8a72d8e06332 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:40.939001 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0fbec4bc-fbc4-47a1-a7d7-8a72d8e06332 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1522 microversion: 2.1 time: 0.521863 Aug 17 23:50:40.939566 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 458/935] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:40 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1522 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:41.156445 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e017d2c5-ea1d-4b62-bb61-3f8a5cd2de7a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:41.157068 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e017d2c5-ea1d-4b62-bb61-3f8a5cd2de7a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:41.163848 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e017d2c5-ea1d-4b62-bb61-3f8a5cd2de7a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:41.164363 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e017d2c5-ea1d-4b62-bb61-3f8a5cd2de7a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:41.164804 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e017d2c5-ea1d-4b62-bb61-3f8a5cd2de7a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:41.165499 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e017d2c5-ea1d-4b62-bb61-3f8a5cd2de7a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:41.165959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e017d2c5-ea1d-4b62-bb61-3f8a5cd2de7a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:41.166384 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e017d2c5-ea1d-4b62-bb61-3f8a5cd2de7a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:41.171449 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:41.307787 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e017d2c5-ea1d-4b62-bb61-3f8a5cd2de7a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:41.316218 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e017d2c5-ea1d-4b62-bb61-3f8a5cd2de7a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1266 microversion: 2.1 time: 0.163907 Aug 17 23:50:41.316785 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 478/936] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:41 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:41.416590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-1681234b-05f2-4c00-85ac-daa9e87ecfc0 req-03ef6b05-9acf-4760-89b4-561c20d515d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "585c4cdc-136f-447b-a24b-fa93a6f21f2e", "tag": "546077da-31e3-4097-ae87-2b6d7eb19979"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:50:41.426129 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-1681234b-05f2-4c00-85ac-daa9e87ecfc0 req-03ef6b05-9acf-4760-89b4-561c20d515d1 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:41.426810 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-1681234b-05f2-4c00-85ac-daa9e87ecfc0 req-03ef6b05-9acf-4760-89b4-561c20d515d1 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:41.427058 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-1681234b-05f2-4c00-85ac-daa9e87ecfc0 req-03ef6b05-9acf-4760-89b4-561c20d515d1 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:41.439900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-1681234b-05f2-4c00-85ac-daa9e87ecfc0 req-03ef6b05-9acf-4760-89b4-561c20d515d1 service nova] Creating event network-changed:546077da-31e3-4097-ae87-2b6d7eb19979 for instance 585c4cdc-136f-447b-a24b-fa93a6f21f2e on hv-cinder-82002 Aug 17 23:50:41.444912 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-1681234b-05f2-4c00-85ac-daa9e87ecfc0 req-03ef6b05-9acf-4760-89b4-561c20d515d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032035 Aug 17 23:50:41.445804 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 459/937] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:41.960095 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-7f408bbe-0e54-4806-976b-c1b9b401ba03 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:41.960702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-7f408bbe-0e54-4806-976b-c1b9b401ba03 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:41.967107 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7f408bbe-0e54-4806-976b-c1b9b401ba03 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:41.967569 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7f408bbe-0e54-4806-976b-c1b9b401ba03 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:41.968033 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7f408bbe-0e54-4806-976b-c1b9b401ba03 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:41.968733 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7f408bbe-0e54-4806-976b-c1b9b401ba03 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:41.969263 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7f408bbe-0e54-4806-976b-c1b9b401ba03 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:41.969685 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7f408bbe-0e54-4806-976b-c1b9b401ba03 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:42.001304 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7f408bbe-0e54-4806-976b-c1b9b401ba03 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:42.001791 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7f408bbe-0e54-4806-976b-c1b9b401ba03 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:42.002212 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7f408bbe-0e54-4806-976b-c1b9b401ba03 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:42.002656 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.objects.instance [None req-7f408bbe-0e54-4806-976b-c1b9b401ba03 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lazy-loading 'fault' on Instance uuid ad01f85b-96a2-474a-85f3-7f7c1fd43db7 {{(pid=131394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:50:42.044250 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-7f408bbe-0e54-4806-976b-c1b9b401ba03 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:42.051647 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-7f408bbe-0e54-4806-976b-c1b9b401ba03 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1312 microversion: 2.1 time: 0.095408 Aug 17 23:50:42.052227 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 479/938] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:41 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:42.338835 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5bcfdea5-def6-4c61-920b-a5707164281e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:42.339831 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5bcfdea5-def6-4c61-920b-a5707164281e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:42.346817 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5bcfdea5-def6-4c61-920b-a5707164281e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:42.347249 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5bcfdea5-def6-4c61-920b-a5707164281e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:42.347689 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5bcfdea5-def6-4c61-920b-a5707164281e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:42.348453 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5bcfdea5-def6-4c61-920b-a5707164281e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:42.348995 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5bcfdea5-def6-4c61-920b-a5707164281e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:42.349419 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5bcfdea5-def6-4c61-920b-a5707164281e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:42.485312 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5bcfdea5-def6-4c61-920b-a5707164281e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:42.492841 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5bcfdea5-def6-4c61-920b-a5707164281e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1266 microversion: 2.1 time: 0.159199 Aug 17 23:50:42.493416 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 460/939] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:42 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:43.072695 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-6f1fcea7-6255-44f4-8544-aa22fb74ef05 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:43.073338 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-6f1fcea7-6255-44f4-8544-aa22fb74ef05 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:43.080512 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6f1fcea7-6255-44f4-8544-aa22fb74ef05 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:43.080996 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6f1fcea7-6255-44f4-8544-aa22fb74ef05 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:43.081438 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6f1fcea7-6255-44f4-8544-aa22fb74ef05 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:43.082128 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6f1fcea7-6255-44f4-8544-aa22fb74ef05 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:43.082581 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6f1fcea7-6255-44f4-8544-aa22fb74ef05 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:43.083008 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6f1fcea7-6255-44f4-8544-aa22fb74ef05 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:43.112959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6f1fcea7-6255-44f4-8544-aa22fb74ef05 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:43.113371 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6f1fcea7-6255-44f4-8544-aa22fb74ef05 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:43.113805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6f1fcea7-6255-44f4-8544-aa22fb74ef05 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:43.114245 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.objects.instance [None req-6f1fcea7-6255-44f4-8544-aa22fb74ef05 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lazy-loading 'fault' on Instance uuid ad01f85b-96a2-474a-85f3-7f7c1fd43db7 {{(pid=131394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:50:43.155657 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-6f1fcea7-6255-44f4-8544-aa22fb74ef05 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67dec924b7e4f0aa0874e6e21879889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc0fe79b67f4446b1a4c36c068f9b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:43.163326 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-6f1fcea7-6255-44f4-8544-aa22fb74ef05 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 200 len: 1312 microversion: 2.1 time: 0.094548 Aug 17 23:50:43.163879 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 480/940] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:43 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:43.462774 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-c5a04a9b-44d5-45cb-8c2a-1b3c4f985461 req-c95392dc-0461-47b4-bd76-762ef6b2a7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad01f85b-96a2-474a-85f3-7f7c1fd43db7", "name": "network-vif-deleted", "tag": "8941515b-b419-450f-837f-9dd12af4a0c2"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:50:43.473019 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-c5a04a9b-44d5-45cb-8c2a-1b3c4f985461 req-c95392dc-0461-47b4-bd76-762ef6b2a7c9 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:43.473506 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-c5a04a9b-44d5-45cb-8c2a-1b3c4f985461 req-c95392dc-0461-47b4-bd76-762ef6b2a7c9 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:43.473969 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-c5a04a9b-44d5-45cb-8c2a-1b3c4f985461 req-c95392dc-0461-47b4-bd76-762ef6b2a7c9 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:43.485357 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-c5a04a9b-44d5-45cb-8c2a-1b3c4f985461 req-c95392dc-0461-47b4-bd76-762ef6b2a7c9 service nova] Creating event network-vif-deleted:8941515b-b419-450f-837f-9dd12af4a0c2 for instance ad01f85b-96a2-474a-85f3-7f7c1fd43db7 on hv-cinder-82002 Aug 17 23:50:43.490188 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-c5a04a9b-44d5-45cb-8c2a-1b3c4f985461 req-c95392dc-0461-47b4-bd76-762ef6b2a7c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031193 Aug 17 23:50:43.490809 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 461/941] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:43.514794 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1fdd8788-7c40-4407-9ad2-bc2e6b5b0d83 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:43.515527 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1fdd8788-7c40-4407-9ad2-bc2e6b5b0d83 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:43.521687 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1fdd8788-7c40-4407-9ad2-bc2e6b5b0d83 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:43.522176 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1fdd8788-7c40-4407-9ad2-bc2e6b5b0d83 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:43.522617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1fdd8788-7c40-4407-9ad2-bc2e6b5b0d83 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:43.523311 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1fdd8788-7c40-4407-9ad2-bc2e6b5b0d83 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:43.523763 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1fdd8788-7c40-4407-9ad2-bc2e6b5b0d83 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:43.524226 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1fdd8788-7c40-4407-9ad2-bc2e6b5b0d83 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:43.664535 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1fdd8788-7c40-4407-9ad2-bc2e6b5b0d83 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:43.673459 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1fdd8788-7c40-4407-9ad2-bc2e6b5b0d83 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1266 microversion: 2.1 time: 0.163225 Aug 17 23:50:43.674249 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 481/942] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:43 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:44.185703 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3b8fdce1-1f78-4281-b837-c15697cbc732 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:44.186395 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3b8fdce1-1f78-4281-b837-c15697cbc732 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] [instance: ad01f85b-96a2-474a-85f3-7f7c1fd43db7] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:44.192478 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b8fdce1-1f78-4281-b837-c15697cbc732 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:44.192958 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b8fdce1-1f78-4281-b837-c15697cbc732 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:44.193391 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b8fdce1-1f78-4281-b837-c15697cbc732 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:44.194080 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b8fdce1-1f78-4281-b837-c15697cbc732 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:44.194534 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b8fdce1-1f78-4281-b837-c15697cbc732 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:44.194976 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3b8fdce1-1f78-4281-b837-c15697cbc732 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:44.208491 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-3b8fdce1-1f78-4281-b837-c15697cbc732 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] HTTP exception thrown: Instance ad01f85b-96a2-474a-85f3-7f7c1fd43db7 could not be found. Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3b8fdce1-1f78-4281-b837-c15697cbc732 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Request method failure captured: Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 HTTP/1.1 Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X0diO02GDVsees0ow7IkXKzIuul6QEmJ2Nv7i9HfBPD7e2j-jzLKTFcjJ8KBABEjBcsMQiTuyNcmjGYaRHOtX6NetLnvMesRTx1pmEyyYO3llMGBjIGxbDgoTaetHgZcL5KAnV1LdBDF1RGbkUDkZ3WWB_pyjiCJNMMeOwgFJjlQuk Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: dbc0fe79b67f4446b1a4c36c068f9b00 Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1988082284 Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:50:44.210053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:50:44.211683 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dbc0fe79b67f4446b1a4c36c068f9b00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dbc0fe79b67f4446b1a4c36c068f9b00", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dbc0fe79b67f4446b1a4c36c068f9b00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dbc0fe79b67f4446b1a4c36c068f9b00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:50:44.211683 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1988082284 Aug 17 23:50:44.211683 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: dbc0fe79b67f4446b1a4c36c068f9b00 Aug 17 23:50:44.211683 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1988082284 Aug 17 23:50:44.211683 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-ServerRescueNegativeTestJSON-1988082284-project Aug 17 23:50:44.211683 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:50:44.211683 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:50:44.211683 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: c67dec924b7e4f0aa0874e6e21879889 Aug 17 23:50:44.211683 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1988082284-project Aug 17 23:50:44.211683 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:50:44.211683 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance ad01f85b-96a2-474a-85f3-7f7c1fd43db7 could not be found. Aug 17 23:50:44.211683 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': 'ad01f85b-96a2-474a-85f3-7f7c1fd43db7'} Aug 17 23:50:44.212779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:50:44.212779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:50:44.212779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:50:44.212779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:50:44.212779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:50:44.212779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:50:44.212779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:50:44.212779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:50:44.212779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:50:44.212779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:50:44.212779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad01f85b-96a2-474a-85f3-7f7c1fd43db7 could not be found. Aug 17 23:50:44.212779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:50:44.212779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:50:44.212779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:50:44.212779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:50:44.212779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:50:44.212779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:50:44.212779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:50:44.212779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:50:44.212779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:50:44.214384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:50:44.214384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:50:44.214384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:50:44.214384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:50:44.214384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:50:44.214384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:50:44.214384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:50:44.214384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad01f85b-96a2-474a-85f3-7f7c1fd43db7 could not be found. Aug 17 23:50:44.214384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:50:44.214384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:50:44.214384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:50:44.214384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:50:44.214384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:50:44.214384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:50:44.214384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:50:44.214384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:50:44.214384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad01f85b-96a2-474a-85f3-7f7c1fd43db7 could not be found. Aug 17 23:50:44.214384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:50:44.215908 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3b8fdce1-1f78-4281-b837-c15697cbc732 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] Returning 404 to user: Instance ad01f85b-96a2-474a-85f3-7f7c1fd43db7 could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:50:44.215908 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3b8fdce1-1f78-4281-b837-c15697cbc732 tempest-ServerRescueNegativeTestJSON-1988082284 tempest-ServerRescueNegativeTestJSON-1988082284-project] 10.222.0.26 "GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7" status: 404 len: 111 microversion: 2.1 time: 0.030757 Aug 17 23:50:44.215908 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 462/943] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:44 2022] GET /compute/v2.1/servers/ad01f85b-96a2-474a-85f3-7f7c1fd43db7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:50:44.695825 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c5c83eb7-4f39-404b-a70e-9b46af454359 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:44.696532 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c5c83eb7-4f39-404b-a70e-9b46af454359 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:44.703487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5c83eb7-4f39-404b-a70e-9b46af454359 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:44.703974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5c83eb7-4f39-404b-a70e-9b46af454359 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:44.704430 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5c83eb7-4f39-404b-a70e-9b46af454359 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:44.705124 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5c83eb7-4f39-404b-a70e-9b46af454359 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:44.705578 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5c83eb7-4f39-404b-a70e-9b46af454359 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:44.705995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c5c83eb7-4f39-404b-a70e-9b46af454359 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:44.924152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c5c83eb7-4f39-404b-a70e-9b46af454359 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:44.931727 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c5c83eb7-4f39-404b-a70e-9b46af454359 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1266 microversion: 2.1 time: 0.239760 Aug 17 23:50:44.932315 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 482/944] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:44 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:45.954010 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b2cce602-7776-4f83-a69d-a3ffc7316a27 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:45.954618 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b2cce602-7776-4f83-a69d-a3ffc7316a27 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:45.957500 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:45.962663 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b2cce602-7776-4f83-a69d-a3ffc7316a27 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:45.963386 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b2cce602-7776-4f83-a69d-a3ffc7316a27 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:45.964610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b2cce602-7776-4f83-a69d-a3ffc7316a27 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:45.965498 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b2cce602-7776-4f83-a69d-a3ffc7316a27 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:45.966663 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b2cce602-7776-4f83-a69d-a3ffc7316a27 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:45.967244 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b2cce602-7776-4f83-a69d-a3ffc7316a27 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:46.114272 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b2cce602-7776-4f83-a69d-a3ffc7316a27 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:46.121943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b2cce602-7776-4f83-a69d-a3ffc7316a27 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1266 microversion: 2.1 time: 0.172364 Aug 17 23:50:46.122629 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 463/945] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:45 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:47.152405 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ecad830a-0503-4304-b990-821b7af555f9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:47.153784 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ecad830a-0503-4304-b990-821b7af555f9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:47.155908 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=2 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:47.156695 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=6 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:47.163681 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ecad830a-0503-4304-b990-821b7af555f9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:47.164221 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ecad830a-0503-4304-b990-821b7af555f9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:47.164665 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ecad830a-0503-4304-b990-821b7af555f9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:47.165371 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ecad830a-0503-4304-b990-821b7af555f9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:47.165826 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ecad830a-0503-4304-b990-821b7af555f9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:47.166256 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ecad830a-0503-4304-b990-821b7af555f9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:47.375433 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ecad830a-0503-4304-b990-821b7af555f9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:47.383532 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ecad830a-0503-4304-b990-821b7af555f9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1266 microversion: 2.1 time: 0.244691 Aug 17 23:50:47.397507 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 483/946] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:47 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:48.405163 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-705f6268-f419-4b1c-861b-2bd27ed270fe tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:48.405779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-705f6268-f419-4b1c-861b-2bd27ed270fe tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:48.412651 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-705f6268-f419-4b1c-861b-2bd27ed270fe tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:48.413015 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-705f6268-f419-4b1c-861b-2bd27ed270fe tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:48.413449 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-705f6268-f419-4b1c-861b-2bd27ed270fe tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:48.414144 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-705f6268-f419-4b1c-861b-2bd27ed270fe tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:48.414599 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-705f6268-f419-4b1c-861b-2bd27ed270fe tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:48.415026 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-705f6268-f419-4b1c-861b-2bd27ed270fe tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:48.564708 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-705f6268-f419-4b1c-861b-2bd27ed270fe tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:48.572120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-705f6268-f419-4b1c-861b-2bd27ed270fe tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1266 microversion: 2.1 time: 0.171337 Aug 17 23:50:48.572707 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 464/947] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:48 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:49.593644 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-72e4a1e7-7c3e-4d8d-9b48-efb74de54fd3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:49.594253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-72e4a1e7-7c3e-4d8d-9b48-efb74de54fd3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:49.600759 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-72e4a1e7-7c3e-4d8d-9b48-efb74de54fd3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:49.601238 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-72e4a1e7-7c3e-4d8d-9b48-efb74de54fd3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:49.601674 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-72e4a1e7-7c3e-4d8d-9b48-efb74de54fd3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:49.602357 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-72e4a1e7-7c3e-4d8d-9b48-efb74de54fd3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:49.602811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-72e4a1e7-7c3e-4d8d-9b48-efb74de54fd3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:49.603233 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-72e4a1e7-7c3e-4d8d-9b48-efb74de54fd3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:49.711599 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-4ec2d126-0a08-4296-be27-ae7fd2ab033b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:50:49.712157 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-4ec2d126-0a08-4296-be27-ae7fd2ab033b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:49.718036 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4ec2d126-0a08-4296-be27-ae7fd2ab033b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:49.718432 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4ec2d126-0a08-4296-be27-ae7fd2ab033b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:49.718876 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4ec2d126-0a08-4296-be27-ae7fd2ab033b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:49.719570 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4ec2d126-0a08-4296-be27-ae7fd2ab033b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:49.720055 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4ec2d126-0a08-4296-be27-ae7fd2ab033b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:49.720484 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4ec2d126-0a08-4296-be27-ae7fd2ab033b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:49.732767 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-72e4a1e7-7c3e-4d8d-9b48-efb74de54fd3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:49.738880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-72e4a1e7-7c3e-4d8d-9b48-efb74de54fd3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1266 microversion: 2.1 time: 0.148972 Aug 17 23:50:49.739782 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 484/948] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:49 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:49.750893 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.objects.instance [None req-4ec2d126-0a08-4296-be27-ae7fd2ab033b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lazy-loading 'flavor' on Instance uuid 93126672-4679-41e5-bfbd-f06836afac17 {{(pid=131395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:50:49.857391 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-4ec2d126-0a08-4296-be27-ae7fd2ab033b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "POST /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17/action" status: 202 len: 0 microversion: 2.1 time: 0.149762 Aug 17 23:50:49.857962 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 465/949] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 17 23:50:49 2022] POST /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 23:50:49.866224 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-959384f5-6519-4507-90f4-d22ebb4d33fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:49.866916 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-959384f5-6519-4507-90f4-d22ebb4d33fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:49.873152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-959384f5-6519-4507-90f4-d22ebb4d33fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:49.873636 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-959384f5-6519-4507-90f4-d22ebb4d33fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:49.874074 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-959384f5-6519-4507-90f4-d22ebb4d33fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:49.874766 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-959384f5-6519-4507-90f4-d22ebb4d33fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:49.875217 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-959384f5-6519-4507-90f4-d22ebb4d33fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:49.875632 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-959384f5-6519-4507-90f4-d22ebb4d33fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:50.017481 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-959384f5-6519-4507-90f4-d22ebb4d33fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:50.021291 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-959384f5-6519-4507-90f4-d22ebb4d33fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.158983 Aug 17 23:50:50.021843 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 485/950] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:49 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:50.026469 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-879f0cbe-f196-4710-8aac-d8a3eceaf47c tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] Calling method '.version_select at 0x7f85fd500820>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:50.074723 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-879f0cbe-f196-4710-8aac-d8a3eceaf47c tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3074fbd2-c3ae-41c0-b6c4-10e20fd0ee01" status: 200 len: 350 microversion: 2.1 time: 0.052525 Aug 17 23:50:50.075885 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 466/951] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 17 23:50:50 2022] GET /compute/v2.1/os-volumes/3074fbd2-c3ae-41c0-b6c4-10e20fd0ee01 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:50:50.759794 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b8ab9647-029c-426c-9ee9-67bf84a4fd19 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:50.760432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b8ab9647-029c-426c-9ee9-67bf84a4fd19 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:50.767443 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8ab9647-029c-426c-9ee9-67bf84a4fd19 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:50.767920 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8ab9647-029c-426c-9ee9-67bf84a4fd19 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:50.768398 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8ab9647-029c-426c-9ee9-67bf84a4fd19 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:50.769063 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8ab9647-029c-426c-9ee9-67bf84a4fd19 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:50.769517 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8ab9647-029c-426c-9ee9-67bf84a4fd19 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:50.769934 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b8ab9647-029c-426c-9ee9-67bf84a4fd19 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:50.906553 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b8ab9647-029c-426c-9ee9-67bf84a4fd19 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:50.914347 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b8ab9647-029c-426c-9ee9-67bf84a4fd19 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1266 microversion: 2.1 time: 0.158470 Aug 17 23:50:50.915050 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 486/952] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:50 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:51.042373 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-d00c4a3b-fa9d-4e96-81e8-fbfbe2abfa15 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:51.043161 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-d00c4a3b-fa9d-4e96-81e8-fbfbe2abfa15 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:51.050012 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d00c4a3b-fa9d-4e96-81e8-fbfbe2abfa15 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:51.050497 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d00c4a3b-fa9d-4e96-81e8-fbfbe2abfa15 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:51.050936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d00c4a3b-fa9d-4e96-81e8-fbfbe2abfa15 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:51.051620 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d00c4a3b-fa9d-4e96-81e8-fbfbe2abfa15 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:51.052110 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d00c4a3b-fa9d-4e96-81e8-fbfbe2abfa15 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:51.052546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d00c4a3b-fa9d-4e96-81e8-fbfbe2abfa15 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:51.181552 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d00c4a3b-fa9d-4e96-81e8-fbfbe2abfa15 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:51.189672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-d00c4a3b-fa9d-4e96-81e8-fbfbe2abfa15 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.151819 Aug 17 23:50:51.190232 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 467/953] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:51 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:51.400235 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-5ba74f71-2284-45ac-a51b-85a1806e933b tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] Calling method '.version_select at 0x7f85fd951700>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:51.448189 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-5ba74f71-2284-45ac-a51b-85a1806e933b tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/78db4af6-95a4-42fe-858c-7a777ddb2b9b" status: 200 len: 351 microversion: 2.1 time: 0.051667 Aug 17 23:50:51.448760 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 487/954] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 17 23:50:51 2022] GET /compute/v2.1/os-volumes/78db4af6-95a4-42fe-858c-7a777ddb2b9b => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:51.936107 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-4899da16-03be-48a0-827f-f4bc9c3b13af tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:51.936649 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-4899da16-03be-48a0-827f-f4bc9c3b13af tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:51.942623 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4899da16-03be-48a0-827f-f4bc9c3b13af tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:51.943108 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4899da16-03be-48a0-827f-f4bc9c3b13af tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:51.943551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4899da16-03be-48a0-827f-f4bc9c3b13af tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:51.944272 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4899da16-03be-48a0-827f-f4bc9c3b13af tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:51.944736 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4899da16-03be-48a0-827f-f4bc9c3b13af tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:51.945168 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4899da16-03be-48a0-827f-f4bc9c3b13af tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:52.077371 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-4899da16-03be-48a0-827f-f4bc9c3b13af tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:52.084817 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-4899da16-03be-48a0-827f-f4bc9c3b13af tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1266 microversion: 2.1 time: 0.152724 Aug 17 23:50:52.085383 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 468/955] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:51 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:52.210347 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f917560c-7941-4ea8-8647-5c3ad10d44c4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:52.210922 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f917560c-7941-4ea8-8647-5c3ad10d44c4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:52.217474 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f917560c-7941-4ea8-8647-5c3ad10d44c4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:52.217955 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f917560c-7941-4ea8-8647-5c3ad10d44c4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:52.218394 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f917560c-7941-4ea8-8647-5c3ad10d44c4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:52.219083 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f917560c-7941-4ea8-8647-5c3ad10d44c4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:52.219534 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f917560c-7941-4ea8-8647-5c3ad10d44c4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:52.219955 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f917560c-7941-4ea8-8647-5c3ad10d44c4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:52.349888 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f917560c-7941-4ea8-8647-5c3ad10d44c4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:52.357345 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f917560c-7941-4ea8-8647-5c3ad10d44c4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.151402 Aug 17 23:50:52.357906 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 488/956] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:52 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:52.783916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-8e69687d-a764-4de0-863c-7fa5bc72157a tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] Calling method '.version_select at 0x7f85fd4f0ee0>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:52.830262 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-8e69687d-a764-4de0-863c-7fa5bc72157a tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/884652d3-5665-413e-a5a3-6187a067204e" status: 200 len: 351 microversion: 2.1 time: 0.050014 Aug 17 23:50:52.830835 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 469/957] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 17 23:50:52 2022] GET /compute/v2.1/os-volumes/884652d3-5665-413e-a5a3-6187a067204e => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:52.844197 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-274164b3-fc10-47a9-91bb-cbbe1cf2aedf tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] Calling method '.version_select at 0x7f85fd967790>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:52.925487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-274164b3-fc10-47a9-91bb-cbbe1cf2aedf tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085994 Aug 17 23:50:52.926047 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 489/958] 10.222.0.26 () {58 vars in 1134 bytes} [Wed Aug 17 23:50:52 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:52.939706 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-171944a0-6c94-4d84-a470-1f9f840e9bfb tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] Calling method '.version_select at 0x7f85fd5001f0>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:52.962953 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-304ccfac-5449-44db-bf01-6359175ff29b req-ac2dfe6f-cff3-4a0c-9bdb-7fdc8d9b113d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "585c4cdc-136f-447b-a24b-fa93a6f21f2e", "name": "network-vif-plugged", "status": "completed", "tag": "546077da-31e3-4097-ae87-2b6d7eb19979"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:50:52.977293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-304ccfac-5449-44db-bf01-6359175ff29b req-ac2dfe6f-cff3-4a0c-9bdb-7fdc8d9b113d service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:52.977710 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-304ccfac-5449-44db-bf01-6359175ff29b req-ac2dfe6f-cff3-4a0c-9bdb-7fdc8d9b113d service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:52.978132 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-304ccfac-5449-44db-bf01-6359175ff29b req-ac2dfe6f-cff3-4a0c-9bdb-7fdc8d9b113d service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:52.989002 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-304ccfac-5449-44db-bf01-6359175ff29b req-ac2dfe6f-cff3-4a0c-9bdb-7fdc8d9b113d service nova] Creating event network-vif-plugged:546077da-31e3-4097-ae87-2b6d7eb19979 for instance 585c4cdc-136f-447b-a24b-fa93a6f21f2e on hv-cinder-82002 Aug 17 23:50:52.994288 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-304ccfac-5449-44db-bf01-6359175ff29b req-ac2dfe6f-cff3-4a0c-9bdb-7fdc8d9b113d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036308 Aug 17 23:50:52.995297 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 490/959] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:53.033476 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-171944a0-6c94-4d84-a470-1f9f840e9bfb tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.097447 Aug 17 23:50:53.034172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 470/960] 10.222.0.26 () {58 vars in 1149 bytes} [Wed Aug 17 23:50:52 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:53.048160 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-24262015-491d-41a1-8d62-a68a6fada5f1 tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] Calling method '.version_select at 0x7f85fd967dc0>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:53.106520 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-76739420-7d0e-4b02-9cfd-1eaa9b3d6230 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:53.107135 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-76739420-7d0e-4b02-9cfd-1eaa9b3d6230 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:53.114123 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-76739420-7d0e-4b02-9cfd-1eaa9b3d6230 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:53.114602 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-76739420-7d0e-4b02-9cfd-1eaa9b3d6230 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:53.115222 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-76739420-7d0e-4b02-9cfd-1eaa9b3d6230 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:53.115909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-76739420-7d0e-4b02-9cfd-1eaa9b3d6230 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:53.116391 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-76739420-7d0e-4b02-9cfd-1eaa9b3d6230 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:53.117005 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-76739420-7d0e-4b02-9cfd-1eaa9b3d6230 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:53.134446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-24262015-491d-41a1-8d62-a68a6fada5f1 tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090681 Aug 17 23:50:53.135015 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 491/961] 10.222.0.26 () {58 vars in 1134 bytes} [Wed Aug 17 23:50:53 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:53.147707 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-0c9c8772-d313-4660-9bcd-c3545010f0e7 tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] Calling method '.version_select at 0x7f85fd951af0>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:53.239778 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-0c9c8772-d313-4660-9bcd-c3545010f0e7 tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.095649 Aug 17 23:50:53.240749 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 492/962] 10.222.0.26 () {58 vars in 1167 bytes} [Wed Aug 17 23:50:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:50:53.255861 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-76739420-7d0e-4b02-9cfd-1eaa9b3d6230 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:53.257471 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e86f9e8f-59b6-4d33-938a-543794345c4d tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] Calling method '.version_select at 0x7f85fd8fd4c0>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:53.259532 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:53.264999 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-76739420-7d0e-4b02-9cfd-1eaa9b3d6230 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1266 microversion: 2.1 time: 0.162749 Aug 17 23:50:53.265563 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 471/963] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:53 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:50:53.342697 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e86f9e8f-59b6-4d33-938a-543794345c4d tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.092539 Aug 17 23:50:53.343277 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 493/964] 10.222.0.26 () {58 vars in 1170 bytes} [Wed Aug 17 23:50:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:53.356796 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-eb7b5b90-ca9d-4fce-bccf-b3a90da15e21 tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] Calling method '.version_select at 0x7f86020419d0>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:53.377807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-27c65e0a-3515-439d-b458-be2a6b608a60 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:53.378566 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-27c65e0a-3515-439d-b458-be2a6b608a60 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:53.384902 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-27c65e0a-3515-439d-b458-be2a6b608a60 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:53.385579 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-27c65e0a-3515-439d-b458-be2a6b608a60 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:53.386086 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-27c65e0a-3515-439d-b458-be2a6b608a60 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:53.386850 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-27c65e0a-3515-439d-b458-be2a6b608a60 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:53.387945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-27c65e0a-3515-439d-b458-be2a6b608a60 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:53.388465 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-27c65e0a-3515-439d-b458-be2a6b608a60 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:53.442837 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-eb7b5b90-ca9d-4fce-bccf-b3a90da15e21 tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.090456 Aug 17 23:50:53.443490 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 472/965] 10.222.0.26 () {58 vars in 1155 bytes} [Wed Aug 17 23:50:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:53.456529 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-74479dc6-1136-429b-8876-3373ad699b32 tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] Calling method '.version_select at 0x7f85fd4f0820>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:53.527015 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-27c65e0a-3515-439d-b458-be2a6b608a60 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:53.536090 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-27c65e0a-3515-439d-b458-be2a6b608a60 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.161972 Aug 17 23:50:53.536718 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 494/966] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:53 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:50:53.537949 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-74479dc6-1136-429b-8876-3373ad699b32 tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085015 Aug 17 23:50:53.538512 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 473/967] 10.222.0.26 () {58 vars in 1188 bytes} [Wed Aug 17 23:50:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:53.550864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ffd42f7b-dfdd-48ea-9a7f-746576b9734e tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] Calling method '.version_select at 0x7f85fd967a60>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:53.629121 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ffd42f7b-dfdd-48ea-9a7f-746576b9734e tempest-VolumesTestJSON-954609716 tempest-VolumesTestJSON-954609716-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.081860 Aug 17 23:50:53.629680 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 495/968] 10.222.0.26 () {58 vars in 1155 bytes} [Wed Aug 17 23:50:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:50:54.286918 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3c9c09d6-b87f-44f7-9c61-08d7284b1cfb tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:54.288547 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3c9c09d6-b87f-44f7-9c61-08d7284b1cfb tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:54.294839 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3c9c09d6-b87f-44f7-9c61-08d7284b1cfb tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:54.295320 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3c9c09d6-b87f-44f7-9c61-08d7284b1cfb tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:54.295751 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3c9c09d6-b87f-44f7-9c61-08d7284b1cfb tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:54.296466 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3c9c09d6-b87f-44f7-9c61-08d7284b1cfb tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:54.296915 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3c9c09d6-b87f-44f7-9c61-08d7284b1cfb tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:54.297336 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3c9c09d6-b87f-44f7-9c61-08d7284b1cfb tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:54.425404 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3c9c09d6-b87f-44f7-9c61-08d7284b1cfb tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:54.432779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3c9c09d6-b87f-44f7-9c61-08d7284b1cfb tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1266 microversion: 2.1 time: 0.150166 Aug 17 23:50:54.433334 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 474/969] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:54 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:54.557699 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-7c39a945-d56e-458d-a0be-443d9d797f95 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:54.558289 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-7c39a945-d56e-458d-a0be-443d9d797f95 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:54.565065 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7c39a945-d56e-458d-a0be-443d9d797f95 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:54.565565 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7c39a945-d56e-458d-a0be-443d9d797f95 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:54.566008 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7c39a945-d56e-458d-a0be-443d9d797f95 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:54.566711 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7c39a945-d56e-458d-a0be-443d9d797f95 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:54.567174 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7c39a945-d56e-458d-a0be-443d9d797f95 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:54.567604 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7c39a945-d56e-458d-a0be-443d9d797f95 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:54.704116 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-7c39a945-d56e-458d-a0be-443d9d797f95 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:54.711610 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-7c39a945-d56e-458d-a0be-443d9d797f95 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.158318 Aug 17 23:50:54.712212 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 496/970] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:54 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:55.455380 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-895fdcad-9acb-43d1-aa61-a89dc5439797 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:55.455922 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-895fdcad-9acb-43d1-aa61-a89dc5439797 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:55.462926 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-895fdcad-9acb-43d1-aa61-a89dc5439797 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:55.463531 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-895fdcad-9acb-43d1-aa61-a89dc5439797 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:55.464078 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-895fdcad-9acb-43d1-aa61-a89dc5439797 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:55.464826 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-895fdcad-9acb-43d1-aa61-a89dc5439797 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:55.465302 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-895fdcad-9acb-43d1-aa61-a89dc5439797 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:55.465756 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-895fdcad-9acb-43d1-aa61-a89dc5439797 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:55.601367 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-895fdcad-9acb-43d1-aa61-a89dc5439797 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:55.609143 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-895fdcad-9acb-43d1-aa61-a89dc5439797 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1266 microversion: 2.1 time: 0.159030 Aug 17 23:50:55.609977 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 475/971] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:55 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:50:55.733633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b1d6f4b5-0e1e-475d-b472-c86310a2d8a4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:55.734245 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b1d6f4b5-0e1e-475d-b472-c86310a2d8a4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:55.740648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b1d6f4b5-0e1e-475d-b472-c86310a2d8a4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:55.741133 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b1d6f4b5-0e1e-475d-b472-c86310a2d8a4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:55.741570 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b1d6f4b5-0e1e-475d-b472-c86310a2d8a4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:55.742260 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b1d6f4b5-0e1e-475d-b472-c86310a2d8a4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:55.742716 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b1d6f4b5-0e1e-475d-b472-c86310a2d8a4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:55.743139 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b1d6f4b5-0e1e-475d-b472-c86310a2d8a4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:55.873090 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b1d6f4b5-0e1e-475d-b472-c86310a2d8a4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:55.880622 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b1d6f4b5-0e1e-475d-b472-c86310a2d8a4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.151435 Aug 17 23:50:55.881329 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 497/972] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:55 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:56.630685 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-59f138c1-7596-4826-aff1-de1917fdd55e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:56.631291 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-59f138c1-7596-4826-aff1-de1917fdd55e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:56.637771 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-59f138c1-7596-4826-aff1-de1917fdd55e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:56.638246 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-59f138c1-7596-4826-aff1-de1917fdd55e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:56.638682 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-59f138c1-7596-4826-aff1-de1917fdd55e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:56.639500 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-59f138c1-7596-4826-aff1-de1917fdd55e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:56.639981 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-59f138c1-7596-4826-aff1-de1917fdd55e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:56.640404 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-59f138c1-7596-4826-aff1-de1917fdd55e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:56.773335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-59f138c1-7596-4826-aff1-de1917fdd55e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:56.781308 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-59f138c1-7596-4826-aff1-de1917fdd55e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1454 microversion: 2.1 time: 0.154480 Aug 17 23:50:56.781882 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 476/973] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:56 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:56.802426 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-fa8e1b19-1e78-49ff-bcb7-feabb2a4973c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:56.803045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-fa8e1b19-1e78-49ff-bcb7-feabb2a4973c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:56.809533 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa8e1b19-1e78-49ff-bcb7-feabb2a4973c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:56.810019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa8e1b19-1e78-49ff-bcb7-feabb2a4973c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:56.810460 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa8e1b19-1e78-49ff-bcb7-feabb2a4973c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:56.811155 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa8e1b19-1e78-49ff-bcb7-feabb2a4973c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:56.811616 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa8e1b19-1e78-49ff-bcb7-feabb2a4973c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:56.812071 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa8e1b19-1e78-49ff-bcb7-feabb2a4973c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:56.901164 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-76febc87-b93a-4c0c-b005-4542d5a43894 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:56.901828 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-76febc87-b93a-4c0c-b005-4542d5a43894 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:56.908200 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-76febc87-b93a-4c0c-b005-4542d5a43894 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:56.908682 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-76febc87-b93a-4c0c-b005-4542d5a43894 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:56.909116 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-76febc87-b93a-4c0c-b005-4542d5a43894 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:56.909810 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-76febc87-b93a-4c0c-b005-4542d5a43894 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:56.910262 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-76febc87-b93a-4c0c-b005-4542d5a43894 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:56.910699 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-76febc87-b93a-4c0c-b005-4542d5a43894 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:56.946112 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-fa8e1b19-1e78-49ff-bcb7-feabb2a4973c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:56.954574 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-fa8e1b19-1e78-49ff-bcb7-feabb2a4973c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1454 microversion: 2.1 time: 0.155855 Aug 17 23:50:56.955175 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 498/974] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:56 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:57.234678 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-76febc87-b93a-4c0c-b005-4542d5a43894 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:57.247821 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-76febc87-b93a-4c0c-b005-4542d5a43894 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.350322 Aug 17 23:50:57.248436 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 477/975] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:56 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:50:58.269583 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-6d62d946-49b8-49af-add6-f130fd881a8c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:58.270334 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-6d62d946-49b8-49af-add6-f130fd881a8c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:58.277192 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6d62d946-49b8-49af-add6-f130fd881a8c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:58.277806 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6d62d946-49b8-49af-add6-f130fd881a8c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:58.278341 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6d62d946-49b8-49af-add6-f130fd881a8c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:58.279126 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6d62d946-49b8-49af-add6-f130fd881a8c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:58.279679 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6d62d946-49b8-49af-add6-f130fd881a8c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:58.280225 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6d62d946-49b8-49af-add6-f130fd881a8c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:58.515505 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-6d62d946-49b8-49af-add6-f130fd881a8c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:58.524432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-6d62d946-49b8-49af-add6-f130fd881a8c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.258124 Aug 17 23:50:58.525487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 499/976] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:58 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:50:58.873003 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-e1486831-94c7-4151-8a14-f8e3d9044f29 req-9fac840b-fdd4-4352-b669-124395a3e2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "585c4cdc-136f-447b-a24b-fa93a6f21f2e", "tag": "546077da-31e3-4097-ae87-2b6d7eb19979"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:50:58.883938 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-e1486831-94c7-4151-8a14-f8e3d9044f29 req-9fac840b-fdd4-4352-b669-124395a3e2e1 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:58.884559 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-e1486831-94c7-4151-8a14-f8e3d9044f29 req-9fac840b-fdd4-4352-b669-124395a3e2e1 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:58.885098 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-e1486831-94c7-4151-8a14-f8e3d9044f29 req-9fac840b-fdd4-4352-b669-124395a3e2e1 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:58.897298 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-e1486831-94c7-4151-8a14-f8e3d9044f29 req-9fac840b-fdd4-4352-b669-124395a3e2e1 service nova] Creating event network-changed:546077da-31e3-4097-ae87-2b6d7eb19979 for instance 585c4cdc-136f-447b-a24b-fa93a6f21f2e on hv-cinder-82002 Aug 17 23:50:58.903078 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-e1486831-94c7-4151-8a14-f8e3d9044f29 req-9fac840b-fdd4-4352-b669-124395a3e2e1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034646 Aug 17 23:50:58.904749 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 478/977] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:50:59.546277 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8cef2ba0-25d9-4253-9078-5654e423366a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:50:59.547098 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8cef2ba0-25d9-4253-9078-5654e423366a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:50:59.554236 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8cef2ba0-25d9-4253-9078-5654e423366a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:59.554866 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8cef2ba0-25d9-4253-9078-5654e423366a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:59.555397 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8cef2ba0-25d9-4253-9078-5654e423366a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:59.556234 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8cef2ba0-25d9-4253-9078-5654e423366a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:50:59.556943 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8cef2ba0-25d9-4253-9078-5654e423366a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:50:59.557598 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8cef2ba0-25d9-4253-9078-5654e423366a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:50:59.708633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-8cef2ba0-25d9-4253-9078-5654e423366a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:50:59.715880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=100 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:50:59.718346 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8cef2ba0-25d9-4253-9078-5654e423366a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.176524 Aug 17 23:50:59.721498 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 500/978] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:50:59 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:00.743634 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-863b0b47-2a28-4f08-b069-b8020114ddb4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:00.744536 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-863b0b47-2a28-4f08-b069-b8020114ddb4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:00.751814 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-863b0b47-2a28-4f08-b069-b8020114ddb4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:00.752481 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-863b0b47-2a28-4f08-b069-b8020114ddb4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:00.752920 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-863b0b47-2a28-4f08-b069-b8020114ddb4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:00.753623 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-863b0b47-2a28-4f08-b069-b8020114ddb4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:00.754080 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-863b0b47-2a28-4f08-b069-b8020114ddb4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:00.754503 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-863b0b47-2a28-4f08-b069-b8020114ddb4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:00.984196 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-863b0b47-2a28-4f08-b069-b8020114ddb4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:00.991620 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-863b0b47-2a28-4f08-b069-b8020114ddb4 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.254298 Aug 17 23:51:00.992201 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 479/979] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:00 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:01.490421 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-7cee043a-d19c-4a3b-9f2c-d715f770e38f tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1826374631"}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:01.491049 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-7cee043a-d19c-4a3b-9f2c-d715f770e38f tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:01.499279 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7cee043a-d19c-4a3b-9f2c-d715f770e38f tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:01.499767 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7cee043a-d19c-4a3b-9f2c-d715f770e38f tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:01.500253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7cee043a-d19c-4a3b-9f2c-d715f770e38f tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:01.500950 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7cee043a-d19c-4a3b-9f2c-d715f770e38f tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:01.501414 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7cee043a-d19c-4a3b-9f2c-d715f770e38f tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:01.501838 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7cee043a-d19c-4a3b-9f2c-d715f770e38f tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:01.709189 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.network.security_group_api [None req-7cee043a-d19c-4a3b-9f2c-d715f770e38f tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Removing security group 380495f3-2c92-480a-8081-bbaf83713f81 from port e95c1c30-368b-4623-86e2-0d608e9a186a Aug 17 23:51:02.014336 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-24b35193-e8b1-4248-a492-68a26b41c6cc tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:02.015096 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-24b35193-e8b1-4248-a492-68a26b41c6cc tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:02.017668 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:51:02.023626 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-24b35193-e8b1-4248-a492-68a26b41c6cc tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:02.024171 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-24b35193-e8b1-4248-a492-68a26b41c6cc tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:02.024636 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-24b35193-e8b1-4248-a492-68a26b41c6cc tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:02.025330 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-24b35193-e8b1-4248-a492-68a26b41c6cc tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:02.025813 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-24b35193-e8b1-4248-a492-68a26b41c6cc tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:02.026233 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-24b35193-e8b1-4248-a492-68a26b41c6cc tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:02.231603 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-24b35193-e8b1-4248-a492-68a26b41c6cc tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:02.239674 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-24b35193-e8b1-4248-a492-68a26b41c6cc tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.230003 Aug 17 23:51:02.240268 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 480/980] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:02 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:51:02.312907 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-7cee043a-d19c-4a3b-9f2c-d715f770e38f tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "POST /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017/action" status: 202 len: 0 microversion: 2.1 time: 0.826860 Aug 17 23:51:02.321016 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 501/981] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 17 23:51:01 2022] POST /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017/action => generated 0 bytes in 832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:51:02.330178 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-f2753770-b9a3-40a1-bf07-ad8d7e15a335 req-f13c129c-3b34-4bc1-9d0e-e78251567c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930c290f-5bb3-44fe-857d-9d5423eca017", "tag": "e95c1c30-368b-4623-86e2-0d608e9a186a"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:02.353381 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-f2753770-b9a3-40a1-bf07-ad8d7e15a335 req-f13c129c-3b34-4bc1-9d0e-e78251567c9e service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:02.357621 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-f2753770-b9a3-40a1-bf07-ad8d7e15a335 req-f13c129c-3b34-4bc1-9d0e-e78251567c9e service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:02.358241 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-f2753770-b9a3-40a1-bf07-ad8d7e15a335 req-f13c129c-3b34-4bc1-9d0e-e78251567c9e service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:02.376456 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-f2753770-b9a3-40a1-bf07-ad8d7e15a335 req-f13c129c-3b34-4bc1-9d0e-e78251567c9e service nova] Creating event network-changed:e95c1c30-368b-4623-86e2-0d608e9a186a for instance 930c290f-5bb3-44fe-857d-9d5423eca017 on hv-cinder-82002 Aug 17 23:51:02.381574 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-f2753770-b9a3-40a1-bf07-ad8d7e15a335 req-f13c129c-3b34-4bc1-9d0e-e78251567c9e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058329 Aug 17 23:51:02.382479 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 481/982] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:51:03.262582 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9e22b5f3-0a67-45b0-b55f-ba1e91e48c9c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:03.263293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9e22b5f3-0a67-45b0-b55f-ba1e91e48c9c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:03.270207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9e22b5f3-0a67-45b0-b55f-ba1e91e48c9c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:03.271053 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9e22b5f3-0a67-45b0-b55f-ba1e91e48c9c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:03.271712 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9e22b5f3-0a67-45b0-b55f-ba1e91e48c9c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:03.272670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9e22b5f3-0a67-45b0-b55f-ba1e91e48c9c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:03.273423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9e22b5f3-0a67-45b0-b55f-ba1e91e48c9c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:03.274046 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9e22b5f3-0a67-45b0-b55f-ba1e91e48c9c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:03.470105 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9e22b5f3-0a67-45b0-b55f-ba1e91e48c9c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:03.480132 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9e22b5f3-0a67-45b0-b55f-ba1e91e48c9c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.222267 Aug 17 23:51:03.481802 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 502/983] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:03 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:04.131371 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9e077db7-be59-4e1b-8125-913ec0b98c9c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:04.132141 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-ab7ad116-f197-4a51-89f2-81803bd0b997 req-6dddde33-0d9f-461b-aca8-1ec1c5fa802c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930c290f-5bb3-44fe-857d-9d5423eca017", "tag": "e95c1c30-368b-4623-86e2-0d608e9a186a"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:04.137269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9e077db7-be59-4e1b-8125-913ec0b98c9c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:04.144398 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9e077db7-be59-4e1b-8125-913ec0b98c9c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:04.147514 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9e077db7-be59-4e1b-8125-913ec0b98c9c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:04.149870 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-ab7ad116-f197-4a51-89f2-81803bd0b997 req-6dddde33-0d9f-461b-aca8-1ec1c5fa802c service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:04.150326 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9e077db7-be59-4e1b-8125-913ec0b98c9c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:04.151265 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9e077db7-be59-4e1b-8125-913ec0b98c9c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:04.152002 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-ab7ad116-f197-4a51-89f2-81803bd0b997 req-6dddde33-0d9f-461b-aca8-1ec1c5fa802c service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:04.152625 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9e077db7-be59-4e1b-8125-913ec0b98c9c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:04.153161 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-ab7ad116-f197-4a51-89f2-81803bd0b997 req-6dddde33-0d9f-461b-aca8-1ec1c5fa802c service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:04.157282 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9e077db7-be59-4e1b-8125-913ec0b98c9c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:04.171914 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-ab7ad116-f197-4a51-89f2-81803bd0b997 req-6dddde33-0d9f-461b-aca8-1ec1c5fa802c service nova] Creating event network-changed:e95c1c30-368b-4623-86e2-0d608e9a186a for instance 930c290f-5bb3-44fe-857d-9d5423eca017 on hv-cinder-82002 Aug 17 23:51:04.181751 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-ab7ad116-f197-4a51-89f2-81803bd0b997 req-6dddde33-0d9f-461b-aca8-1ec1c5fa802c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056666 Aug 17 23:51:04.187237 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 503/984] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:51:04.248010 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.objects.instance [None req-9e077db7-be59-4e1b-8125-913ec0b98c9c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lazy-loading 'services' on Instance uuid 930c290f-5bb3-44fe-857d-9d5423eca017 {{(pid=131395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:51:04.342971 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9e077db7-be59-4e1b-8125-913ec0b98c9c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "DELETE /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017/os-volume_attachments/cf86aff8-f4dd-49fe-aac3-4c7b91c9bdb5" status: 202 len: 0 microversion: 2.1 time: 0.222891 Aug 17 23:51:04.347331 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 482/985] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 17 23:51:04 2022] DELETE /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017/os-volume_attachments/cf86aff8-f4dd-49fe-aac3-4c7b91c9bdb5 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 23:51:04.357167 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-efecd5f5-a18c-4b45-b188-219b796d38ac tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:04.361847 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-efecd5f5-a18c-4b45-b188-219b796d38ac tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:04.381076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-efecd5f5-a18c-4b45-b188-219b796d38ac tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:04.381829 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-efecd5f5-a18c-4b45-b188-219b796d38ac tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:04.382581 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-efecd5f5-a18c-4b45-b188-219b796d38ac tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:04.384043 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-efecd5f5-a18c-4b45-b188-219b796d38ac tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:04.385305 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-efecd5f5-a18c-4b45-b188-219b796d38ac tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:04.386186 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-efecd5f5-a18c-4b45-b188-219b796d38ac tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:04.428284 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-efecd5f5-a18c-4b45-b188-219b796d38ac tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077931 Aug 17 23:51:04.430033 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 504/986] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:51:04 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:51:04.504980 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-7dd74b98-dc59-438e-ad34-5d16a23f3002 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:04.506753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-7dd74b98-dc59-438e-ad34-5d16a23f3002 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:04.513795 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7dd74b98-dc59-438e-ad34-5d16a23f3002 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:04.514288 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7dd74b98-dc59-438e-ad34-5d16a23f3002 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:04.514758 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7dd74b98-dc59-438e-ad34-5d16a23f3002 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:04.515460 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7dd74b98-dc59-438e-ad34-5d16a23f3002 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:04.515919 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7dd74b98-dc59-438e-ad34-5d16a23f3002 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:04.516405 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7dd74b98-dc59-438e-ad34-5d16a23f3002 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:04.679232 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7dd74b98-dc59-438e-ad34-5d16a23f3002 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:04.689665 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-7dd74b98-dc59-438e-ad34-5d16a23f3002 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.187301 Aug 17 23:51:04.689665 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 483/987] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:04 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:05.441964 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-00d03243-7c4b-4458-b9fc-b26eb7667601 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:05.444306 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-00d03243-7c4b-4458-b9fc-b26eb7667601 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:05.452276 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-00d03243-7c4b-4458-b9fc-b26eb7667601 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:05.456297 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-00d03243-7c4b-4458-b9fc-b26eb7667601 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:05.458962 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-00d03243-7c4b-4458-b9fc-b26eb7667601 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:05.459919 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-00d03243-7c4b-4458-b9fc-b26eb7667601 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:05.460406 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-00d03243-7c4b-4458-b9fc-b26eb7667601 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:05.461525 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-00d03243-7c4b-4458-b9fc-b26eb7667601 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:05.506950 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-00d03243-7c4b-4458-b9fc-b26eb7667601 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068888 Aug 17 23:51:05.507590 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 505/988] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:51:05 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:51:05.708416 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-097f88dd-73c2-4c0c-9932-b8f599cd84c3 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:05.709074 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-097f88dd-73c2-4c0c-9932-b8f599cd84c3 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:05.715899 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-097f88dd-73c2-4c0c-9932-b8f599cd84c3 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:05.716424 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-097f88dd-73c2-4c0c-9932-b8f599cd84c3 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:05.716880 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-097f88dd-73c2-4c0c-9932-b8f599cd84c3 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:05.717569 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-097f88dd-73c2-4c0c-9932-b8f599cd84c3 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:05.718034 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-097f88dd-73c2-4c0c-9932-b8f599cd84c3 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:05.718462 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-097f88dd-73c2-4c0c-9932-b8f599cd84c3 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:05.945419 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-097f88dd-73c2-4c0c-9932-b8f599cd84c3 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:05.954417 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-097f88dd-73c2-4c0c-9932-b8f599cd84c3 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.250070 Aug 17 23:51:05.955001 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 484/989] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:05 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:06.519109 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-fd077359-f764-47c9-af82-c2c4887f36bd tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:06.521291 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-fd077359-f764-47c9-af82-c2c4887f36bd tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:06.523676 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:51:06.529178 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fd077359-f764-47c9-af82-c2c4887f36bd tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:06.529665 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fd077359-f764-47c9-af82-c2c4887f36bd tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:06.530104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fd077359-f764-47c9-af82-c2c4887f36bd tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:06.530794 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fd077359-f764-47c9-af82-c2c4887f36bd tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:06.531249 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fd077359-f764-47c9-af82-c2c4887f36bd tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:06.531672 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fd077359-f764-47c9-af82-c2c4887f36bd tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:06.562578 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-fd077359-f764-47c9-af82-c2c4887f36bd tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047340 Aug 17 23:51:06.563276 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 506/990] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:51:06 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 23:51:06.575443 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b598f587-9434-4eed-bc65-1d214c34d717 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:06.576040 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b598f587-9434-4eed-bc65-1d214c34d717 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:06.581980 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b598f587-9434-4eed-bc65-1d214c34d717 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:06.582465 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b598f587-9434-4eed-bc65-1d214c34d717 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:06.582904 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b598f587-9434-4eed-bc65-1d214c34d717 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:06.583600 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b598f587-9434-4eed-bc65-1d214c34d717 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:06.584084 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b598f587-9434-4eed-bc65-1d214c34d717 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:06.584510 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b598f587-9434-4eed-bc65-1d214c34d717 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:06.657748 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-b598f587-9434-4eed-bc65-1d214c34d717 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] HTTP exception thrown: Instance 930c290f-5bb3-44fe-857d-9d5423eca017 is not attached to volume cf86aff8-f4dd-49fe-aac3-4c7b91c9bdb5 Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b598f587-9434-4eed-bc65-1d214c34d717 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Request method failure captured: Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: DELETE /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017/os-volume_attachments/cf86aff8-f4dd-49fe-aac3-4c7b91c9bdb5 HTTP/1.1 Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X3ltQiowVQhq0o7pKOiSrq8sGnx8nd7pXXtCnd26MxGpKMQfjDCWLzGvI2Q4z39wAPCuMUzxbIFn7t7qXPHm_9NsGptdbiJMWePLBpDo7w5F20VgCdq0eEVbO0tzBZmRU9PGypcyRapMdDfrSpGmva-nUokOJMuZkixdehQ6MmtuV4 Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: b3ff5d4d64a740cabdc0144fe0b475ea Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-TestMinimumBasicScenario-1698884314 Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:51:06.660141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:51:06.661537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3ff5d4d64a740cabdc0144fe0b475ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3ff5d4d64a740cabdc0144fe0b475ea", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3ff5d4d64a740cabdc0144fe0b475ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3ff5d4d64a740cabdc0144fe0b475ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:51:06.661537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-TestMinimumBasicScenario-1698884314 Aug 17 23:51:06.661537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: b3ff5d4d64a740cabdc0144fe0b475ea Aug 17 23:51:06.661537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1698884314 Aug 17 23:51:06.661537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-TestMinimumBasicScenario-1698884314-project Aug 17 23:51:06.661537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:51:06.661537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:51:06.661537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 006f31b802f94549a517df90180dca36 Aug 17 23:51:06.661537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-TestMinimumBasicScenario-1698884314-project Aug 17 23:51:06.661537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:51:06.661537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance 930c290f-5bb3-44fe-857d-9d5423eca017 is not attached to volume cf86aff8-f4dd-49fe-aac3-4c7b91c9bdb5 Aug 17 23:51:06.662530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'server_id': '930c290f-5bb3-44fe-857d-9d5423eca017', 'id': 'cf86aff8-f4dd-49fe-aac3-4c7b91c9bdb5'} Aug 17 23:51:06.662530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:51:06.662530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:51:06.662530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 17 23:51:06.662530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 17 23:51:06.662530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 23:51:06.662530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 23:51:06.662530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 17 23:51:06.662530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 17 23:51:06.662530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cf86aff8-f4dd-49fe-aac3-4c7b91c9bdb5. Aug 17 23:51:06.662530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:51:06.662530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:51:06.662530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:51:06.662530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:51:06.662530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:51:06.662530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:51:06.662530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:51:06.662530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:51:06.662530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:51:06.663728 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:51:06.663728 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 17 23:51:06.663728 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 17 23:51:06.663728 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 930c290f-5bb3-44fe-857d-9d5423eca017 is not attached to volume cf86aff8-f4dd-49fe-aac3-4c7b91c9bdb5 Aug 17 23:51:06.663728 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:51:06.663728 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:51:06.663728 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:51:06.663728 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:51:06.663728 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:51:06.663728 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:51:06.663728 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:51:06.663728 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:51:06.663728 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 930c290f-5bb3-44fe-857d-9d5423eca017 is not attached to volume cf86aff8-f4dd-49fe-aac3-4c7b91c9bdb5 Aug 17 23:51:06.663728 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:51:06.663728 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b598f587-9434-4eed-bc65-1d214c34d717 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Returning 404 to user: Instance 930c290f-5bb3-44fe-857d-9d5423eca017 is not attached to volume cf86aff8-f4dd-49fe-aac3-4c7b91c9bdb5 {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:51:06.665468 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b598f587-9434-4eed-bc65-1d214c34d717 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "DELETE /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017/os-volume_attachments/cf86aff8-f4dd-49fe-aac3-4c7b91c9bdb5" status: 404 len: 154 microversion: 2.1 time: 0.091170 Aug 17 23:51:06.665468 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 485/991] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 17 23:51:06 2022] DELETE /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017/os-volume_attachments/cf86aff8-f4dd-49fe-aac3-4c7b91c9bdb5 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 23:51:06.977114 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b5528e29-8571-47e6-ba8f-b22d486f6702 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:06.978275 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b5528e29-8571-47e6-ba8f-b22d486f6702 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:06.985337 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b5528e29-8571-47e6-ba8f-b22d486f6702 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:06.985901 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b5528e29-8571-47e6-ba8f-b22d486f6702 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:06.986408 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b5528e29-8571-47e6-ba8f-b22d486f6702 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:06.987235 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b5528e29-8571-47e6-ba8f-b22d486f6702 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:06.987845 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b5528e29-8571-47e6-ba8f-b22d486f6702 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:06.988307 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b5528e29-8571-47e6-ba8f-b22d486f6702 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:07.129253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b5528e29-8571-47e6-ba8f-b22d486f6702 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:07.137321 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b5528e29-8571-47e6-ba8f-b22d486f6702 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.164917 Aug 17 23:51:07.137886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 507/992] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:06 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:07.810405 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-72aba606-da9f-4892-9b65-9b0f4d5b820c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:07.811587 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-72aba606-da9f-4892-9b65-9b0f4d5b820c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:07.818327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-72aba606-da9f-4892-9b65-9b0f4d5b820c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:07.818815 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-72aba606-da9f-4892-9b65-9b0f4d5b820c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:07.819251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-72aba606-da9f-4892-9b65-9b0f4d5b820c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:07.819956 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-72aba606-da9f-4892-9b65-9b0f4d5b820c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:07.820442 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-72aba606-da9f-4892-9b65-9b0f4d5b820c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:07.820866 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-72aba606-da9f-4892-9b65-9b0f4d5b820c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:07.851655 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-72aba606-da9f-4892-9b65-9b0f4d5b820c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Going to try to terminate instance {{(pid=131395) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:51:07.942886 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-72aba606-da9f-4892-9b65-9b0f4d5b820c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "DELETE /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 204 len: 0 microversion: 2.1 time: 0.137184 Aug 17 23:51:07.943774 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 486/993] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:51:07 2022] DELETE /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 23:51:07.952789 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c4b4d575-d25d-4aa7-835a-fad85f01420c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:07.953397 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c4b4d575-d25d-4aa7-835a-fad85f01420c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:07.959671 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c4b4d575-d25d-4aa7-835a-fad85f01420c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:07.960199 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c4b4d575-d25d-4aa7-835a-fad85f01420c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:07.960835 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c4b4d575-d25d-4aa7-835a-fad85f01420c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:07.961520 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c4b4d575-d25d-4aa7-835a-fad85f01420c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:07.961970 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c4b4d575-d25d-4aa7-835a-fad85f01420c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:07.962395 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c4b4d575-d25d-4aa7-835a-fad85f01420c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:08.100912 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c4b4d575-d25d-4aa7-835a-fad85f01420c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:08.109241 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c4b4d575-d25d-4aa7-835a-fad85f01420c tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1554 microversion: 2.1 time: 0.160818 Aug 17 23:51:08.112346 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 508/994] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:07 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:08.158932 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ceda4a71-f50d-4c28-a916-86b5ec2cc8c2 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:08.159784 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ceda4a71-f50d-4c28-a916-86b5ec2cc8c2 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:08.167634 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ceda4a71-f50d-4c28-a916-86b5ec2cc8c2 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:08.168337 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ceda4a71-f50d-4c28-a916-86b5ec2cc8c2 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:08.168771 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ceda4a71-f50d-4c28-a916-86b5ec2cc8c2 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:08.169472 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ceda4a71-f50d-4c28-a916-86b5ec2cc8c2 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:08.169923 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ceda4a71-f50d-4c28-a916-86b5ec2cc8c2 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:08.170347 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ceda4a71-f50d-4c28-a916-86b5ec2cc8c2 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:08.309551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ceda4a71-f50d-4c28-a916-86b5ec2cc8c2 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:08.317085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ceda4a71-f50d-4c28-a916-86b5ec2cc8c2 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.162459 Aug 17 23:51:08.317646 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 487/995] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:08 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:09.130590 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1ce0d842-0623-42c3-8f1e-fd9d923bf062 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:09.131251 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1ce0d842-0623-42c3-8f1e-fd9d923bf062 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:09.137702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1ce0d842-0623-42c3-8f1e-fd9d923bf062 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:09.138182 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1ce0d842-0623-42c3-8f1e-fd9d923bf062 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:09.139121 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1ce0d842-0623-42c3-8f1e-fd9d923bf062 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:09.139811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1ce0d842-0623-42c3-8f1e-fd9d923bf062 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:09.140307 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1ce0d842-0623-42c3-8f1e-fd9d923bf062 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:09.140730 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1ce0d842-0623-42c3-8f1e-fd9d923bf062 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:09.274472 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1ce0d842-0623-42c3-8f1e-fd9d923bf062 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:09.282636 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1ce0d842-0623-42c3-8f1e-fd9d923bf062 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1554 microversion: 2.1 time: 0.155871 Aug 17 23:51:09.283206 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 509/996] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:09 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:09.337662 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1d738c43-5120-45b6-a361-d55031f40e59 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:09.338278 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-1d738c43-5120-45b6-a361-d55031f40e59 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:09.345171 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1d738c43-5120-45b6-a361-d55031f40e59 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:09.345684 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1d738c43-5120-45b6-a361-d55031f40e59 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:09.346119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1d738c43-5120-45b6-a361-d55031f40e59 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:09.346808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1d738c43-5120-45b6-a361-d55031f40e59 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:09.347265 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1d738c43-5120-45b6-a361-d55031f40e59 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:09.347688 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1d738c43-5120-45b6-a361-d55031f40e59 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:09.483291 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1d738c43-5120-45b6-a361-d55031f40e59 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:09.491708 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-1d738c43-5120-45b6-a361-d55031f40e59 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.157774 Aug 17 23:51:09.492313 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 488/997] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:09 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:10.305964 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c1e13ee7-1678-43bb-8681-b62c363cb4d2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:10.306750 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c1e13ee7-1678-43bb-8681-b62c363cb4d2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:10.312966 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c1e13ee7-1678-43bb-8681-b62c363cb4d2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:10.313542 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c1e13ee7-1678-43bb-8681-b62c363cb4d2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:10.314054 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c1e13ee7-1678-43bb-8681-b62c363cb4d2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:10.314853 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c1e13ee7-1678-43bb-8681-b62c363cb4d2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:10.315409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c1e13ee7-1678-43bb-8681-b62c363cb4d2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:10.315917 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c1e13ee7-1678-43bb-8681-b62c363cb4d2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:10.483318 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c1e13ee7-1678-43bb-8681-b62c363cb4d2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:10.491007 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c1e13ee7-1678-43bb-8681-b62c363cb4d2 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1554 microversion: 2.1 time: 0.190894 Aug 17 23:51:10.496159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 510/998] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:10 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:10.513091 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a05f5e1e-343d-44b8-a37f-85c3e94c06c5 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:10.514700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a05f5e1e-343d-44b8-a37f-85c3e94c06c5 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:10.520626 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a05f5e1e-343d-44b8-a37f-85c3e94c06c5 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:10.521115 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a05f5e1e-343d-44b8-a37f-85c3e94c06c5 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:10.521554 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a05f5e1e-343d-44b8-a37f-85c3e94c06c5 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:10.522261 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a05f5e1e-343d-44b8-a37f-85c3e94c06c5 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:10.522721 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a05f5e1e-343d-44b8-a37f-85c3e94c06c5 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:10.523152 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a05f5e1e-343d-44b8-a37f-85c3e94c06c5 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:10.541770 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:51:10.660548 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a05f5e1e-343d-44b8-a37f-85c3e94c06c5 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:10.674427 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a05f5e1e-343d-44b8-a37f-85c3e94c06c5 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1510 microversion: 2.1 time: 0.165306 Aug 17 23:51:10.675004 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 489/999] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:10 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:10.694696 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-37369fa8-3b70-4e5a-a711-f5704f64652e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:10.695301 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-37369fa8-3b70-4e5a-a711-f5704f64652e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:10.701772 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-37369fa8-3b70-4e5a-a711-f5704f64652e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:10.702259 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-37369fa8-3b70-4e5a-a711-f5704f64652e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:10.702699 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-37369fa8-3b70-4e5a-a711-f5704f64652e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:10.703391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-37369fa8-3b70-4e5a-a711-f5704f64652e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:10.703856 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-37369fa8-3b70-4e5a-a711-f5704f64652e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:10.704315 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-37369fa8-3b70-4e5a-a711-f5704f64652e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:10.749158 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-37369fa8-3b70-4e5a-a711-f5704f64652e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=131394) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 23:51:10.820477 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-37369fa8-3b70-4e5a-a711-f5704f64652e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "POST /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17/action" status: 202 len: 0 microversion: 2.1 time: 0.129364 Aug 17 23:51:10.824076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 511/1000] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Aug 17 23:51:10 2022] POST /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:51:10.832987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0d510263-ac9f-4759-bc1b-5a86675d1965 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:10.838687 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0d510263-ac9f-4759-bc1b-5a86675d1965 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:10.847244 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0d510263-ac9f-4759-bc1b-5a86675d1965 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:10.847996 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0d510263-ac9f-4759-bc1b-5a86675d1965 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:10.848875 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0d510263-ac9f-4759-bc1b-5a86675d1965 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:10.850264 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0d510263-ac9f-4759-bc1b-5a86675d1965 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:10.851062 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0d510263-ac9f-4759-bc1b-5a86675d1965 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:10.851758 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0d510263-ac9f-4759-bc1b-5a86675d1965 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:11.114087 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0d510263-ac9f-4759-bc1b-5a86675d1965 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:11.125272 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0d510263-ac9f-4759-bc1b-5a86675d1965 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1518 microversion: 2.1 time: 0.299614 Aug 17 23:51:11.138780 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 490/1001] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:10 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1518 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:11.403471 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-4beec1e8-9d22-4f14-8f61-5348fcf7b383 req-b21420cb-72e1-48c8-af69-6829842c43df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930c290f-5bb3-44fe-857d-9d5423eca017", "name": "network-vif-deleted", "tag": "e95c1c30-368b-4623-86e2-0d608e9a186a"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:11.416625 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-4beec1e8-9d22-4f14-8f61-5348fcf7b383 req-b21420cb-72e1-48c8-af69-6829842c43df service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:11.417107 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-4beec1e8-9d22-4f14-8f61-5348fcf7b383 req-b21420cb-72e1-48c8-af69-6829842c43df service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:11.417559 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-4beec1e8-9d22-4f14-8f61-5348fcf7b383 req-b21420cb-72e1-48c8-af69-6829842c43df service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:11.430168 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-4beec1e8-9d22-4f14-8f61-5348fcf7b383 req-b21420cb-72e1-48c8-af69-6829842c43df service nova] Creating event network-vif-deleted:e95c1c30-368b-4623-86e2-0d608e9a186a for instance 930c290f-5bb3-44fe-857d-9d5423eca017 on hv-cinder-82002 Aug 17 23:51:11.436092 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-4beec1e8-9d22-4f14-8f61-5348fcf7b383 req-b21420cb-72e1-48c8-af69-6829842c43df service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037348 Aug 17 23:51:11.437224 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 512/1002] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:51:11.512521 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-559aa72c-062b-4991-8374-441e4d31ce00 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:11.513254 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-559aa72c-062b-4991-8374-441e4d31ce00 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:11.520306 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-559aa72c-062b-4991-8374-441e4d31ce00 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:11.521018 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-559aa72c-062b-4991-8374-441e4d31ce00 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:11.521690 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-559aa72c-062b-4991-8374-441e4d31ce00 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:11.522616 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-559aa72c-062b-4991-8374-441e4d31ce00 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:11.523229 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-559aa72c-062b-4991-8374-441e4d31ce00 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:11.523883 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-559aa72c-062b-4991-8374-441e4d31ce00 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:11.614735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-559aa72c-062b-4991-8374-441e4d31ce00 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006f31b802f94549a517df90180dca36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3ff5d4d64a740cabdc0144fe0b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:11.626344 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-559aa72c-062b-4991-8374-441e4d31ce00 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 200 len: 1343 microversion: 2.1 time: 0.117903 Aug 17 23:51:11.627122 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 491/1003] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:11 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 1343 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:12.148136 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-590185ad-ed1e-4ccf-b012-feb0969144fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:12.148976 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-590185ad-ed1e-4ccf-b012-feb0969144fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:12.156304 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-590185ad-ed1e-4ccf-b012-feb0969144fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:12.156939 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-590185ad-ed1e-4ccf-b012-feb0969144fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:12.157624 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-590185ad-ed1e-4ccf-b012-feb0969144fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:12.158548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-590185ad-ed1e-4ccf-b012-feb0969144fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:12.159165 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-590185ad-ed1e-4ccf-b012-feb0969144fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:12.159749 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-590185ad-ed1e-4ccf-b012-feb0969144fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:12.305230 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-590185ad-ed1e-4ccf-b012-feb0969144fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:12.313005 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-590185ad-ed1e-4ccf-b012-feb0969144fb tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1520 microversion: 2.1 time: 0.169337 Aug 17 23:51:12.313561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 513/1004] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:12 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:12.646720 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f19c524c-187c-478d-a18a-64dac8beb1f5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:12.647331 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f19c524c-187c-478d-a18a-64dac8beb1f5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] [instance: 930c290f-5bb3-44fe-857d-9d5423eca017] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:12.653665 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f19c524c-187c-478d-a18a-64dac8beb1f5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:12.654146 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f19c524c-187c-478d-a18a-64dac8beb1f5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:12.654582 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f19c524c-187c-478d-a18a-64dac8beb1f5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:12.655402 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f19c524c-187c-478d-a18a-64dac8beb1f5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:12.655944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f19c524c-187c-478d-a18a-64dac8beb1f5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:12.656399 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f19c524c-187c-478d-a18a-64dac8beb1f5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:12.670192 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-f19c524c-187c-478d-a18a-64dac8beb1f5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] HTTP exception thrown: Instance 930c290f-5bb3-44fe-857d-9d5423eca017 could not be found. Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f19c524c-187c-478d-a18a-64dac8beb1f5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Request method failure captured: Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 HTTP/1.1 Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X3ltQiowVQhq0o7pKOiSrq8sGnx8nd7pXXtCnd26MxGpKMQfjDCWLzGvI2Q4z39wAPCuMUzxbIFn7t7qXPHm_9NsGptdbiJMWePLBpDo7w5F20VgCdq0eEVbO0tzBZmRU9PGypcyRapMdDfrSpGmva-nUokOJMuZkixdehQ6MmtuV4 Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: b3ff5d4d64a740cabdc0144fe0b475ea Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-TestMinimumBasicScenario-1698884314 Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:51:12.671840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:51:12.673581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3ff5d4d64a740cabdc0144fe0b475ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3ff5d4d64a740cabdc0144fe0b475ea", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3ff5d4d64a740cabdc0144fe0b475ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3ff5d4d64a740cabdc0144fe0b475ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:51:12.673581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-TestMinimumBasicScenario-1698884314 Aug 17 23:51:12.673581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: b3ff5d4d64a740cabdc0144fe0b475ea Aug 17 23:51:12.673581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1698884314 Aug 17 23:51:12.673581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-TestMinimumBasicScenario-1698884314-project Aug 17 23:51:12.673581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:51:12.673581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:51:12.673581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 006f31b802f94549a517df90180dca36 Aug 17 23:51:12.673581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-TestMinimumBasicScenario-1698884314-project Aug 17 23:51:12.673581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:51:12.673581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance 930c290f-5bb3-44fe-857d-9d5423eca017 could not be found. Aug 17 23:51:12.673581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': '930c290f-5bb3-44fe-857d-9d5423eca017'} Aug 17 23:51:12.674692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:51:12.674692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:51:12.674692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:51:12.674692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:51:12.674692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:51:12.674692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:51:12.674692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:51:12.674692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:51:12.674692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:51:12.674692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:51:12.674692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 930c290f-5bb3-44fe-857d-9d5423eca017 could not be found. Aug 17 23:51:12.674692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:51:12.674692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:51:12.674692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:51:12.674692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:51:12.674692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:51:12.674692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:51:12.674692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:51:12.674692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:51:12.674692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:51:12.676619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:51:12.676619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:51:12.676619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:51:12.676619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:51:12.676619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:51:12.676619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:51:12.676619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:51:12.676619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 930c290f-5bb3-44fe-857d-9d5423eca017 could not be found. Aug 17 23:51:12.676619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:51:12.676619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:51:12.676619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:51:12.676619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:51:12.676619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:51:12.676619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:51:12.676619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:51:12.676619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:51:12.676619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 930c290f-5bb3-44fe-857d-9d5423eca017 could not be found. Aug 17 23:51:12.676619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:51:12.678028 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f19c524c-187c-478d-a18a-64dac8beb1f5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Returning 404 to user: Instance 930c290f-5bb3-44fe-857d-9d5423eca017 could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:51:12.678028 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f19c524c-187c-478d-a18a-64dac8beb1f5 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017" status: 404 len: 111 microversion: 2.1 time: 0.030500 Aug 17 23:51:12.678028 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 492/1005] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:12 2022] GET /compute/v2.1/servers/930c290f-5bb3-44fe-857d-9d5423eca017 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:51:12.687411 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-fa42c644-d749-4030-bf2e-a9b250af5a44 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] Calling method '.version_select at 0x7f85fd855b80>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:12.706970 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-fa42c644-d749-4030-bf2e-a9b250af5a44 tempest-TestMinimumBasicScenario-1698884314 tempest-TestMinimumBasicScenario-1698884314-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1623198100" status: 202 len: 0 microversion: 2.1 time: 0.023988 Aug 17 23:51:12.707696 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 514/1006] 10.222.0.26 () {58 vars in 1272 bytes} [Wed Aug 17 23:51:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1623198100 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:51:13.230105 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-c5f0d68e-0631-4351-91cb-78af77dc3269 req-b243ca86-c3c8-4364-b646-ad3a80fd461d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93126672-4679-41e5-bfbd-f06836afac17", "name": "network-vif-unplugged", "status": "completed", "tag": "da8d102a-c017-4932-bfb8-b3ef13097d11"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:13.245433 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-c5f0d68e-0631-4351-91cb-78af77dc3269 req-b243ca86-c3c8-4364-b646-ad3a80fd461d service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:13.247106 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-c5f0d68e-0631-4351-91cb-78af77dc3269 req-b243ca86-c3c8-4364-b646-ad3a80fd461d service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:13.248350 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-c5f0d68e-0631-4351-91cb-78af77dc3269 req-b243ca86-c3c8-4364-b646-ad3a80fd461d service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:13.262930 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-c5f0d68e-0631-4351-91cb-78af77dc3269 req-b243ca86-c3c8-4364-b646-ad3a80fd461d service nova] Creating event network-vif-unplugged:da8d102a-c017-4932-bfb8-b3ef13097d11 for instance 93126672-4679-41e5-bfbd-f06836afac17 on hv-cinder-82002 Aug 17 23:51:13.271766 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-c5f0d68e-0631-4351-91cb-78af77dc3269 req-b243ca86-c3c8-4364-b646-ad3a80fd461d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047920 Aug 17 23:51:13.273832 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 493/1007] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:51:13.335687 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-dcf6c2fb-48a7-413b-81d8-484a34e4b95c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:13.336487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-dcf6c2fb-48a7-413b-81d8-484a34e4b95c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:13.343029 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dcf6c2fb-48a7-413b-81d8-484a34e4b95c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:13.343604 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dcf6c2fb-48a7-413b-81d8-484a34e4b95c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:13.344161 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dcf6c2fb-48a7-413b-81d8-484a34e4b95c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:13.345248 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dcf6c2fb-48a7-413b-81d8-484a34e4b95c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:13.345850 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dcf6c2fb-48a7-413b-81d8-484a34e4b95c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:13.346400 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dcf6c2fb-48a7-413b-81d8-484a34e4b95c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:13.605913 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dcf6c2fb-48a7-413b-81d8-484a34e4b95c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:13.618361 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-dcf6c2fb-48a7-413b-81d8-484a34e4b95c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1576 microversion: 2.1 time: 0.286854 Aug 17 23:51:13.619057 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 515/1008] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:13 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1576 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:13.757172 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-78b72bfe-7d52-4377-a1b2-a60a5b9f82a7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1613172015", "imageRef": "a3cf81e5-e973-4c08-b1da-4e8f104b52a1", "flavorRef": "452", "networks": [{"uuid": "ae251991-1c50-49af-a7b5-d2ec49964c2b"}]}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:13.811707 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.network.neutron [None req-78b72bfe-7d52-4377-a1b2-a60a5b9f82a7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] validate_networks() for [('ae251991-1c50-49af-a7b5-d2ec49964c2b', None, None, None, None, None)] {{(pid=131395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:51:14.423944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-78b72bfe-7d52-4377-a1b2-a60a5b9f82a7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Flavor limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:51:14.424716 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-78b72bfe-7d52-4377-a1b2-a60a5b9f82a7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Image limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:51:14.425192 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-78b72bfe-7d52-4377-a1b2-a60a5b9f82a7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Flavor pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:51:14.425782 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-78b72bfe-7d52-4377-a1b2-a60a5b9f82a7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Image pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:51:14.426200 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-78b72bfe-7d52-4377-a1b2-a60a5b9f82a7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:51:14.436224 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-78b72bfe-7d52-4377-a1b2-a60a5b9f82a7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:14.436723 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-78b72bfe-7d52-4377-a1b2-a60a5b9f82a7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:14.437188 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-78b72bfe-7d52-4377-a1b2-a60a5b9f82a7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:14.437931 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-78b72bfe-7d52-4377-a1b2-a60a5b9f82a7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:14.438400 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-78b72bfe-7d52-4377-a1b2-a60a5b9f82a7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:14.438828 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-78b72bfe-7d52-4377-a1b2-a60a5b9f82a7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:14.459956 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-78b72bfe-7d52-4377-a1b2-a60a5b9f82a7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Getting quotas for project 2ccde22a7c8a4a9bbfaab1dad9240f34. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:51:14.466061 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-78b72bfe-7d52-4377-a1b2-a60a5b9f82a7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Getting quotas for user 185b05ace78d4e369cb0354a0865fd52 and project 2ccde22a7c8a4a9bbfaab1dad9240f34. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:51:14.479411 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-78b72bfe-7d52-4377-a1b2-a60a5b9f82a7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Going to run 1 instances... {{(pid=131395) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:51:14.482353 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-78b72bfe-7d52-4377-a1b2-a60a5b9f82a7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a3cf81e5-e973-4c08-b1da-4e8f104b52a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:51:14.528737 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-78b72bfe-7d52-4377-a1b2-a60a5b9f82a7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.775598 Aug 17 23:51:14.529632 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 494/1009] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 17 23:51:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 23:51:14.540105 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8686aa85-e202-465d-a98a-fd2f13be110b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:14.540727 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8686aa85-e202-465d-a98a-fd2f13be110b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:14.603502 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-8686aa85-e202-465d-a98a-fd2f13be110b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:14.611095 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8686aa85-e202-465d-a98a-fd2f13be110b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e" status: 200 len: 1214 microversion: 2.1 time: 0.074887 Aug 17 23:51:14.611486 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 516/1010] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:14 2022] GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:14.643484 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-7d02f541-dd24-4e97-969e-08611336c4af tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:14.644654 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-7d02f541-dd24-4e97-969e-08611336c4af tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:14.655803 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7d02f541-dd24-4e97-969e-08611336c4af tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:14.656399 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7d02f541-dd24-4e97-969e-08611336c4af tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:14.656948 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7d02f541-dd24-4e97-969e-08611336c4af tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:14.657871 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7d02f541-dd24-4e97-969e-08611336c4af tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:14.658223 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7d02f541-dd24-4e97-969e-08611336c4af tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:14.658715 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7d02f541-dd24-4e97-969e-08611336c4af tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:14.807696 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7d02f541-dd24-4e97-969e-08611336c4af tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:14.815619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-7d02f541-dd24-4e97-969e-08611336c4af tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1576 microversion: 2.1 time: 0.176653 Aug 17 23:51:14.816335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 495/1011] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:14 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:15.632321 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-693f3416-7a34-4a37-a49c-498fc02e7383 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:15.634374 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-693f3416-7a34-4a37-a49c-498fc02e7383 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:15.644801 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-693f3416-7a34-4a37-a49c-498fc02e7383 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:15.645290 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-693f3416-7a34-4a37-a49c-498fc02e7383 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:15.645725 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-693f3416-7a34-4a37-a49c-498fc02e7383 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:15.646536 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-693f3416-7a34-4a37-a49c-498fc02e7383 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:15.646988 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-693f3416-7a34-4a37-a49c-498fc02e7383 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:15.647537 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-693f3416-7a34-4a37-a49c-498fc02e7383 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:15.734239 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-693f3416-7a34-4a37-a49c-498fc02e7383 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:15.741989 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-693f3416-7a34-4a37-a49c-498fc02e7383 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e" status: 200 len: 1266 microversion: 2.1 time: 0.113660 Aug 17 23:51:15.755774 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 517/1012] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:15 2022] GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:15.841236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-97f21b49-3d80-4cad-a04c-3cc3f93cef07 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:15.842455 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-97f21b49-3d80-4cad-a04c-3cc3f93cef07 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:15.850984 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-97f21b49-3d80-4cad-a04c-3cc3f93cef07 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:15.851519 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-97f21b49-3d80-4cad-a04c-3cc3f93cef07 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:15.852230 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-97f21b49-3d80-4cad-a04c-3cc3f93cef07 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:15.853039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-97f21b49-3d80-4cad-a04c-3cc3f93cef07 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:15.853542 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-97f21b49-3d80-4cad-a04c-3cc3f93cef07 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:15.854228 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-97f21b49-3d80-4cad-a04c-3cc3f93cef07 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:16.094132 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-97f21b49-3d80-4cad-a04c-3cc3f93cef07 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:16.109726 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-97f21b49-3d80-4cad-a04c-3cc3f93cef07 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1576 microversion: 2.1 time: 0.272423 Aug 17 23:51:16.110837 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 496/1013] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:15 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1576 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:16.762671 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-432ec345-301b-42fb-8e2b-40fc99a328ab tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:16.763333 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-432ec345-301b-42fb-8e2b-40fc99a328ab tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:16.769791 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-432ec345-301b-42fb-8e2b-40fc99a328ab tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:16.770485 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-432ec345-301b-42fb-8e2b-40fc99a328ab tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:16.770922 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-432ec345-301b-42fb-8e2b-40fc99a328ab tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:16.771838 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-432ec345-301b-42fb-8e2b-40fc99a328ab tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:16.772506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-432ec345-301b-42fb-8e2b-40fc99a328ab tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:16.773125 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-432ec345-301b-42fb-8e2b-40fc99a328ab tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:17.048327 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-432ec345-301b-42fb-8e2b-40fc99a328ab tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:17.059395 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-432ec345-301b-42fb-8e2b-40fc99a328ab tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e" status: 200 len: 1314 microversion: 2.1 time: 0.300409 Aug 17 23:51:17.060419 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 518/1014] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:16 2022] GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:17.134076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ae899305-3d99-4d72-a250-e0aa565e7f35 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:17.134684 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ae899305-3d99-4d72-a250-e0aa565e7f35 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:17.142099 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ae899305-3d99-4d72-a250-e0aa565e7f35 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:17.142595 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ae899305-3d99-4d72-a250-e0aa565e7f35 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:17.143029 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ae899305-3d99-4d72-a250-e0aa565e7f35 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:17.143725 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ae899305-3d99-4d72-a250-e0aa565e7f35 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:17.144491 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ae899305-3d99-4d72-a250-e0aa565e7f35 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:17.145361 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ae899305-3d99-4d72-a250-e0aa565e7f35 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:17.358141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ae899305-3d99-4d72-a250-e0aa565e7f35 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:17.366531 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ae899305-3d99-4d72-a250-e0aa565e7f35 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1576 microversion: 2.1 time: 0.236252 Aug 17 23:51:17.367347 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 497/1015] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:17 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1576 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:17.425023 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-035d0899-a3dc-4399-bd47-e4070030ec4b req-95a98f37-0e6c-4bea-aa3d-19e4f6d0c454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6afc38f5-a423-4cc8-a9a4-a44ab929fc7e", "tag": "2228c6b5-9a86-4725-94fd-1c82818bb21f"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:17.447201 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-035d0899-a3dc-4399-bd47-e4070030ec4b req-95a98f37-0e6c-4bea-aa3d-19e4f6d0c454 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:17.448273 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-035d0899-a3dc-4399-bd47-e4070030ec4b req-95a98f37-0e6c-4bea-aa3d-19e4f6d0c454 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:17.448881 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-035d0899-a3dc-4399-bd47-e4070030ec4b req-95a98f37-0e6c-4bea-aa3d-19e4f6d0c454 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:17.462531 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-035d0899-a3dc-4399-bd47-e4070030ec4b req-95a98f37-0e6c-4bea-aa3d-19e4f6d0c454 service nova] Creating event network-changed:2228c6b5-9a86-4725-94fd-1c82818bb21f for instance 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e on hv-cinder-82002 Aug 17 23:51:17.468648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-035d0899-a3dc-4399-bd47-e4070030ec4b req-95a98f37-0e6c-4bea-aa3d-19e4f6d0c454 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059170 Aug 17 23:51:17.469763 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 519/1016] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:51:18.080700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-26e4627f-8e7b-4f92-ac4a-b1598f50120e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:18.081351 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-26e4627f-8e7b-4f92-ac4a-b1598f50120e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:18.088842 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-26e4627f-8e7b-4f92-ac4a-b1598f50120e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:18.089268 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-26e4627f-8e7b-4f92-ac4a-b1598f50120e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:18.089709 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-26e4627f-8e7b-4f92-ac4a-b1598f50120e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:18.090407 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-26e4627f-8e7b-4f92-ac4a-b1598f50120e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:18.090862 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-26e4627f-8e7b-4f92-ac4a-b1598f50120e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:18.091795 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-26e4627f-8e7b-4f92-ac4a-b1598f50120e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:18.224191 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-26e4627f-8e7b-4f92-ac4a-b1598f50120e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:18.231745 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-26e4627f-8e7b-4f92-ac4a-b1598f50120e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e" status: 200 len: 1314 microversion: 2.1 time: 0.154849 Aug 17 23:51:18.232244 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 498/1017] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:18 2022] GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:18.390227 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c0d63352-7be7-4c77-9635-f1156ccb1488 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:18.390931 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c0d63352-7be7-4c77-9635-f1156ccb1488 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:18.397414 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0d63352-7be7-4c77-9635-f1156ccb1488 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:18.397906 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0d63352-7be7-4c77-9635-f1156ccb1488 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:18.398346 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0d63352-7be7-4c77-9635-f1156ccb1488 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:18.399039 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0d63352-7be7-4c77-9635-f1156ccb1488 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:18.399667 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0d63352-7be7-4c77-9635-f1156ccb1488 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:18.400283 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c0d63352-7be7-4c77-9635-f1156ccb1488 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:18.594761 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c0d63352-7be7-4c77-9635-f1156ccb1488 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:18.598246 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:51:18.603545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c0d63352-7be7-4c77-9635-f1156ccb1488 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1576 microversion: 2.1 time: 0.218762 Aug 17 23:51:18.616897 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 520/1018] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:18 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1576 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:19.252505 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-589af4af-8dc0-449f-a1a2-0c40ce1865cc tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:19.253123 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-589af4af-8dc0-449f-a1a2-0c40ce1865cc tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:19.259729 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-589af4af-8dc0-449f-a1a2-0c40ce1865cc tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:19.260046 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-589af4af-8dc0-449f-a1a2-0c40ce1865cc tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:19.260485 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-589af4af-8dc0-449f-a1a2-0c40ce1865cc tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:19.261189 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-589af4af-8dc0-449f-a1a2-0c40ce1865cc tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:19.261652 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-589af4af-8dc0-449f-a1a2-0c40ce1865cc tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:19.262083 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-589af4af-8dc0-449f-a1a2-0c40ce1865cc tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:19.468377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-589af4af-8dc0-449f-a1a2-0c40ce1865cc tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:19.476149 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-589af4af-8dc0-449f-a1a2-0c40ce1865cc tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e" status: 200 len: 1314 microversion: 2.1 time: 0.227349 Aug 17 23:51:19.476737 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 499/1019] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:19 2022] GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:19.626979 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-79e307b7-b082-4317-86a2-2c13e73400ce tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:19.627719 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-79e307b7-b082-4317-86a2-2c13e73400ce tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:19.636262 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-79e307b7-b082-4317-86a2-2c13e73400ce tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:19.636874 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-79e307b7-b082-4317-86a2-2c13e73400ce tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:19.637434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-79e307b7-b082-4317-86a2-2c13e73400ce tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:19.638750 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-79e307b7-b082-4317-86a2-2c13e73400ce tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:19.639306 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-79e307b7-b082-4317-86a2-2c13e73400ce tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:19.639792 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-79e307b7-b082-4317-86a2-2c13e73400ce tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:20.040553 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-79e307b7-b082-4317-86a2-2c13e73400ce tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:20.048250 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-79e307b7-b082-4317-86a2-2c13e73400ce tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1576 microversion: 2.1 time: 0.427412 Aug 17 23:51:20.048822 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 521/1020] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:19 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1576 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:20.498268 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-abb2e1af-928d-407a-a34e-38d8d363f65b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:20.498885 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-abb2e1af-928d-407a-a34e-38d8d363f65b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:20.505292 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-abb2e1af-928d-407a-a34e-38d8d363f65b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:20.505869 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-abb2e1af-928d-407a-a34e-38d8d363f65b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:20.506318 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-abb2e1af-928d-407a-a34e-38d8d363f65b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:20.507023 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-abb2e1af-928d-407a-a34e-38d8d363f65b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:20.507476 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-abb2e1af-928d-407a-a34e-38d8d363f65b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:20.507900 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-abb2e1af-928d-407a-a34e-38d8d363f65b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:20.703955 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-abb2e1af-928d-407a-a34e-38d8d363f65b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:20.712439 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-abb2e1af-928d-407a-a34e-38d8d363f65b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e" status: 200 len: 1314 microversion: 2.1 time: 0.218611 Aug 17 23:51:20.713011 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 500/1021] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:20 2022] GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:21.069740 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ef226cfd-eb3a-4def-a7b0-de85092cd96d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:21.070357 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ef226cfd-eb3a-4def-a7b0-de85092cd96d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:21.076770 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ef226cfd-eb3a-4def-a7b0-de85092cd96d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:21.077262 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ef226cfd-eb3a-4def-a7b0-de85092cd96d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:21.077710 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ef226cfd-eb3a-4def-a7b0-de85092cd96d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:21.078481 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ef226cfd-eb3a-4def-a7b0-de85092cd96d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:21.078859 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ef226cfd-eb3a-4def-a7b0-de85092cd96d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:21.079293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ef226cfd-eb3a-4def-a7b0-de85092cd96d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:21.221540 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ef226cfd-eb3a-4def-a7b0-de85092cd96d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:21.231027 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ef226cfd-eb3a-4def-a7b0-de85092cd96d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1576 microversion: 2.1 time: 0.165018 Aug 17 23:51:21.231795 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 522/1022] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:21 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:21.734149 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e4565c10-f417-4787-859a-6bd898d85f1c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:21.734767 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e4565c10-f417-4787-859a-6bd898d85f1c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:21.741233 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e4565c10-f417-4787-859a-6bd898d85f1c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:21.741752 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e4565c10-f417-4787-859a-6bd898d85f1c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:21.742195 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e4565c10-f417-4787-859a-6bd898d85f1c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:21.742916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e4565c10-f417-4787-859a-6bd898d85f1c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:21.743402 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e4565c10-f417-4787-859a-6bd898d85f1c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:21.743826 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e4565c10-f417-4787-859a-6bd898d85f1c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:21.871207 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e4565c10-f417-4787-859a-6bd898d85f1c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:21.879156 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e4565c10-f417-4787-859a-6bd898d85f1c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e" status: 200 len: 1314 microversion: 2.1 time: 0.148981 Aug 17 23:51:21.879716 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 501/1023] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:21 2022] GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:22.252141 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-3d46d48c-7b6f-4521-ab0e-791b917a706c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:22.252758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-3d46d48c-7b6f-4521-ab0e-791b917a706c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:22.259115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3d46d48c-7b6f-4521-ab0e-791b917a706c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:22.259597 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3d46d48c-7b6f-4521-ab0e-791b917a706c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:22.260064 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3d46d48c-7b6f-4521-ab0e-791b917a706c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:22.260761 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3d46d48c-7b6f-4521-ab0e-791b917a706c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:22.261216 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3d46d48c-7b6f-4521-ab0e-791b917a706c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:22.261639 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3d46d48c-7b6f-4521-ab0e-791b917a706c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:22.393095 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-3d46d48c-7b6f-4521-ab0e-791b917a706c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:22.400635 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-3d46d48c-7b6f-4521-ab0e-791b917a706c tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1576 microversion: 2.1 time: 0.152426 Aug 17 23:51:22.401211 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 523/1024] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:22 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:22.899798 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-17f0c123-afbe-44f4-a64f-281ff21cffb5 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:22.900451 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-17f0c123-afbe-44f4-a64f-281ff21cffb5 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:22.907361 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-17f0c123-afbe-44f4-a64f-281ff21cffb5 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:22.907849 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-17f0c123-afbe-44f4-a64f-281ff21cffb5 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:22.908319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-17f0c123-afbe-44f4-a64f-281ff21cffb5 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:22.909046 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-17f0c123-afbe-44f4-a64f-281ff21cffb5 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:22.909506 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-17f0c123-afbe-44f4-a64f-281ff21cffb5 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:22.909936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-17f0c123-afbe-44f4-a64f-281ff21cffb5 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:23.039541 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-17f0c123-afbe-44f4-a64f-281ff21cffb5 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:23.046983 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-17f0c123-afbe-44f4-a64f-281ff21cffb5 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e" status: 200 len: 1314 microversion: 2.1 time: 0.151070 Aug 17 23:51:23.047559 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 502/1025] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:22 2022] GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:23.423581 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-65f613fc-03bf-4147-a190-e655f60fe6cd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:23.424961 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-65f613fc-03bf-4147-a190-e655f60fe6cd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:23.432433 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-65f613fc-03bf-4147-a190-e655f60fe6cd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:23.432930 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-65f613fc-03bf-4147-a190-e655f60fe6cd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:23.433595 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-65f613fc-03bf-4147-a190-e655f60fe6cd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:23.434518 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-65f613fc-03bf-4147-a190-e655f60fe6cd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:23.435870 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-65f613fc-03bf-4147-a190-e655f60fe6cd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:23.436393 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-65f613fc-03bf-4147-a190-e655f60fe6cd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:23.579648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-65f613fc-03bf-4147-a190-e655f60fe6cd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:23.587354 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-65f613fc-03bf-4147-a190-e655f60fe6cd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1576 microversion: 2.1 time: 0.168488 Aug 17 23:51:23.587916 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 524/1026] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:23 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:51:24.066808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c2185e4b-4014-4680-a01a-ffed5b87514f tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:24.067422 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c2185e4b-4014-4680-a01a-ffed5b87514f tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:24.073837 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c2185e4b-4014-4680-a01a-ffed5b87514f tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:24.074319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c2185e4b-4014-4680-a01a-ffed5b87514f tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:24.074759 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c2185e4b-4014-4680-a01a-ffed5b87514f tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:24.075452 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c2185e4b-4014-4680-a01a-ffed5b87514f tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:24.075915 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c2185e4b-4014-4680-a01a-ffed5b87514f tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:24.076365 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c2185e4b-4014-4680-a01a-ffed5b87514f tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:24.203207 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c2185e4b-4014-4680-a01a-ffed5b87514f tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:24.210638 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c2185e4b-4014-4680-a01a-ffed5b87514f tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e" status: 200 len: 1314 microversion: 2.1 time: 0.147691 Aug 17 23:51:24.211247 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 503/1027] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:24 2022] GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:24.609962 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-69178e37-ab8a-41d3-a8cd-44ffc548cf54 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:24.611489 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-69178e37-ab8a-41d3-a8cd-44ffc548cf54 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:24.617025 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=2 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:51:24.621509 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-69178e37-ab8a-41d3-a8cd-44ffc548cf54 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:24.622601 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-69178e37-ab8a-41d3-a8cd-44ffc548cf54 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:24.623230 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-69178e37-ab8a-41d3-a8cd-44ffc548cf54 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:24.623937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-69178e37-ab8a-41d3-a8cd-44ffc548cf54 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:24.624421 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-69178e37-ab8a-41d3-a8cd-44ffc548cf54 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:24.625469 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-69178e37-ab8a-41d3-a8cd-44ffc548cf54 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:24.778518 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-69178e37-ab8a-41d3-a8cd-44ffc548cf54 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:24.786511 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-69178e37-ab8a-41d3-a8cd-44ffc548cf54 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1563 microversion: 2.1 time: 0.181499 Aug 17 23:51:24.787559 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 525/1028] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:24 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1563 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:25.232420 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-97d4c845-bc10-457a-99ca-f244a52f2dd7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:25.233039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-97d4c845-bc10-457a-99ca-f244a52f2dd7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:25.235067 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:51:25.235822 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=6 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:51:25.242157 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-97d4c845-bc10-457a-99ca-f244a52f2dd7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:25.242637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-97d4c845-bc10-457a-99ca-f244a52f2dd7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:25.243070 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-97d4c845-bc10-457a-99ca-f244a52f2dd7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:25.243750 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-97d4c845-bc10-457a-99ca-f244a52f2dd7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:25.244228 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-97d4c845-bc10-457a-99ca-f244a52f2dd7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:25.244648 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-97d4c845-bc10-457a-99ca-f244a52f2dd7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:25.374864 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-97d4c845-bc10-457a-99ca-f244a52f2dd7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:25.381993 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-97d4c845-bc10-457a-99ca-f244a52f2dd7 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e" status: 200 len: 1314 microversion: 2.1 time: 0.154087 Aug 17 23:51:25.382552 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 504/1029] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:25 2022] GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:25.627870 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-fa2a0324-c4ff-4477-b09a-e7ae98f706a0 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:25.630111 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-fa2a0324-c4ff-4477-b09a-e7ae98f706a0 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:25.636527 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa2a0324-c4ff-4477-b09a-e7ae98f706a0 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:25.637008 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa2a0324-c4ff-4477-b09a-e7ae98f706a0 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:25.637446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa2a0324-c4ff-4477-b09a-e7ae98f706a0 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:25.638134 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa2a0324-c4ff-4477-b09a-e7ae98f706a0 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:25.638586 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa2a0324-c4ff-4477-b09a-e7ae98f706a0 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:25.639007 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa2a0324-c4ff-4477-b09a-e7ae98f706a0 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:25.666518 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-fa2a0324-c4ff-4477-b09a-e7ae98f706a0 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042533 Aug 17 23:51:25.667059 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 526/1030] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:51:25 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 23:51:25.728575 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ce077dc1-c2f2-45e5-963d-538139c0f93f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:25.729071 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ce077dc1-c2f2-45e5-963d-538139c0f93f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:25.735487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ce077dc1-c2f2-45e5-963d-538139c0f93f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:25.735989 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ce077dc1-c2f2-45e5-963d-538139c0f93f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:25.736422 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ce077dc1-c2f2-45e5-963d-538139c0f93f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:25.737178 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ce077dc1-c2f2-45e5-963d-538139c0f93f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:25.737630 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ce077dc1-c2f2-45e5-963d-538139c0f93f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:25.738051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ce077dc1-c2f2-45e5-963d-538139c0f93f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:25.764971 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ce077dc1-c2f2-45e5-963d-538139c0f93f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Going to try to terminate instance {{(pid=131395) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:51:25.839455 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ce077dc1-c2f2-45e5-963d-538139c0f93f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "DELETE /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 204 len: 0 microversion: 2.1 time: 0.114341 Aug 17 23:51:25.840413 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 505/1031] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:51:25 2022] DELETE /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 23:51:25.848957 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-24e40782-27a0-44a4-b396-9d7e2355c471 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:25.849670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-24e40782-27a0-44a4-b396-9d7e2355c471 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:25.855801 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-24e40782-27a0-44a4-b396-9d7e2355c471 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:25.856395 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-24e40782-27a0-44a4-b396-9d7e2355c471 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:25.857371 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-24e40782-27a0-44a4-b396-9d7e2355c471 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:25.858066 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-24e40782-27a0-44a4-b396-9d7e2355c471 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:25.858524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-24e40782-27a0-44a4-b396-9d7e2355c471 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:25.858947 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-24e40782-27a0-44a4-b396-9d7e2355c471 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:25.989213 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-24e40782-27a0-44a4-b396-9d7e2355c471 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:25.996927 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-24e40782-27a0-44a4-b396-9d7e2355c471 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1672 microversion: 2.1 time: 0.152112 Aug 17 23:51:25.997489 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 527/1032] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:25 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:26.403246 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5c9d6fad-1c4e-4336-80d9-6b7a59f8e432 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:26.404539 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5c9d6fad-1c4e-4336-80d9-6b7a59f8e432 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:26.410863 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5c9d6fad-1c4e-4336-80d9-6b7a59f8e432 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:26.411345 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5c9d6fad-1c4e-4336-80d9-6b7a59f8e432 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:26.411777 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5c9d6fad-1c4e-4336-80d9-6b7a59f8e432 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:26.412750 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5c9d6fad-1c4e-4336-80d9-6b7a59f8e432 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:26.413200 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5c9d6fad-1c4e-4336-80d9-6b7a59f8e432 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:26.413620 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5c9d6fad-1c4e-4336-80d9-6b7a59f8e432 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:26.431300 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:51:26.543561 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5c9d6fad-1c4e-4336-80d9-6b7a59f8e432 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:26.551002 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5c9d6fad-1c4e-4336-80d9-6b7a59f8e432 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e" status: 200 len: 1314 microversion: 2.1 time: 0.152028 Aug 17 23:51:26.551559 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 506/1033] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:26 2022] GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:26.811892 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-63f7529d-36af-4287-8c2a-f12ad9881485 req-1d5427b6-f3f1-43af-8eff-17acf8a4b0bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6afc38f5-a423-4cc8-a9a4-a44ab929fc7e", "name": "network-vif-plugged", "status": "completed", "tag": "2228c6b5-9a86-4725-94fd-1c82818bb21f"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:26.821444 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-63f7529d-36af-4287-8c2a-f12ad9881485 req-1d5427b6-f3f1-43af-8eff-17acf8a4b0bd service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:26.821921 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-63f7529d-36af-4287-8c2a-f12ad9881485 req-1d5427b6-f3f1-43af-8eff-17acf8a4b0bd service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:26.822542 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-63f7529d-36af-4287-8c2a-f12ad9881485 req-1d5427b6-f3f1-43af-8eff-17acf8a4b0bd service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:26.834200 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-63f7529d-36af-4287-8c2a-f12ad9881485 req-1d5427b6-f3f1-43af-8eff-17acf8a4b0bd service nova] Creating event network-vif-plugged:2228c6b5-9a86-4725-94fd-1c82818bb21f for instance 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e on hv-cinder-82002 Aug 17 23:51:26.839104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-63f7529d-36af-4287-8c2a-f12ad9881485 req-1d5427b6-f3f1-43af-8eff-17acf8a4b0bd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031501 Aug 17 23:51:26.839692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 528/1034] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:51:27.019392 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a268fa80-4ae8-4101-9dc0-e7e8b0f55d4c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:27.020332 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a268fa80-4ae8-4101-9dc0-e7e8b0f55d4c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:27.026480 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a268fa80-4ae8-4101-9dc0-e7e8b0f55d4c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:27.027096 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a268fa80-4ae8-4101-9dc0-e7e8b0f55d4c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:27.027598 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a268fa80-4ae8-4101-9dc0-e7e8b0f55d4c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:27.028405 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a268fa80-4ae8-4101-9dc0-e7e8b0f55d4c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:27.028920 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a268fa80-4ae8-4101-9dc0-e7e8b0f55d4c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:27.029416 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a268fa80-4ae8-4101-9dc0-e7e8b0f55d4c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:27.157529 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a268fa80-4ae8-4101-9dc0-e7e8b0f55d4c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:27.165425 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a268fa80-4ae8-4101-9dc0-e7e8b0f55d4c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1672 microversion: 2.1 time: 0.151073 Aug 17 23:51:27.165928 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 507/1035] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:27 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:27.572855 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-6ce59ef6-ce11-49bc-a843-ebcb5139b1c3 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:27.573553 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-6ce59ef6-ce11-49bc-a843-ebcb5139b1c3 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:27.579547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6ce59ef6-ce11-49bc-a843-ebcb5139b1c3 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:27.580071 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6ce59ef6-ce11-49bc-a843-ebcb5139b1c3 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:27.580505 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6ce59ef6-ce11-49bc-a843-ebcb5139b1c3 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:27.581214 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6ce59ef6-ce11-49bc-a843-ebcb5139b1c3 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:27.581723 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6ce59ef6-ce11-49bc-a843-ebcb5139b1c3 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:27.582147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6ce59ef6-ce11-49bc-a843-ebcb5139b1c3 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:27.716759 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-6ce59ef6-ce11-49bc-a843-ebcb5139b1c3 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:27.724284 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-6ce59ef6-ce11-49bc-a843-ebcb5139b1c3 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e" status: 200 len: 1314 microversion: 2.1 time: 0.156078 Aug 17 23:51:27.724832 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 529/1036] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:27 2022] GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:28.187374 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5383d574-682b-48f4-bad9-006487123702 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:28.188151 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5383d574-682b-48f4-bad9-006487123702 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:28.194865 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5383d574-682b-48f4-bad9-006487123702 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:28.195353 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5383d574-682b-48f4-bad9-006487123702 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:28.195800 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5383d574-682b-48f4-bad9-006487123702 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:28.196542 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5383d574-682b-48f4-bad9-006487123702 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:28.197000 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5383d574-682b-48f4-bad9-006487123702 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:28.197429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5383d574-682b-48f4-bad9-006487123702 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:28.280564 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5383d574-682b-48f4-bad9-006487123702 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:28.290468 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5383d574-682b-48f4-bad9-006487123702 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1604 microversion: 2.1 time: 0.106941 Aug 17 23:51:28.290968 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 508/1037] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:28 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1604 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:28.316554 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-c132061b-395a-4126-bc20-f3fa38aebdbc req-fac74cf8-c2d5-4f0d-8c7c-38151426149d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b92554-3f2a-482c-bcf5-1f5f05631227", "name": "network-vif-deleted", "tag": "c9a2d576-b43b-452b-bd44-887c08463ddb"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:28.326395 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-c132061b-395a-4126-bc20-f3fa38aebdbc req-fac74cf8-c2d5-4f0d-8c7c-38151426149d service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:28.326963 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-c132061b-395a-4126-bc20-f3fa38aebdbc req-fac74cf8-c2d5-4f0d-8c7c-38151426149d service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:28.327457 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-c132061b-395a-4126-bc20-f3fa38aebdbc req-fac74cf8-c2d5-4f0d-8c7c-38151426149d service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:28.338577 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-c132061b-395a-4126-bc20-f3fa38aebdbc req-fac74cf8-c2d5-4f0d-8c7c-38151426149d service nova] Creating event network-vif-deleted:c9a2d576-b43b-452b-bd44-887c08463ddb for instance 16b92554-3f2a-482c-bcf5-1f5f05631227 on hv-cinder-82002 Aug 17 23:51:28.343892 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-c132061b-395a-4126-bc20-f3fa38aebdbc req-fac74cf8-c2d5-4f0d-8c7c-38151426149d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030871 Aug 17 23:51:28.344816 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 530/1038] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:51:28.746355 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-4996e160-58f1-4934-9691-5eab647e9d30 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:28.746991 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-4996e160-58f1-4934-9691-5eab647e9d30 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:28.753742 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4996e160-58f1-4934-9691-5eab647e9d30 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:28.754342 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4996e160-58f1-4934-9691-5eab647e9d30 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:28.754859 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4996e160-58f1-4934-9691-5eab647e9d30 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:28.755671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4996e160-58f1-4934-9691-5eab647e9d30 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:28.756376 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4996e160-58f1-4934-9691-5eab647e9d30 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:28.756751 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4996e160-58f1-4934-9691-5eab647e9d30 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:28.875199 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-f744b4ce-b13d-4c89-9b2f-3a96a1d4a3dd req-32d51ddf-de38-4c8f-945d-eb5d0eaf28e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93126672-4679-41e5-bfbd-f06836afac17", "name": "network-vif-plugged", "status": "completed", "tag": "da8d102a-c017-4932-bfb8-b3ef13097d11"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:28.887018 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-f744b4ce-b13d-4c89-9b2f-3a96a1d4a3dd req-32d51ddf-de38-4c8f-945d-eb5d0eaf28e9 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:28.887764 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-f744b4ce-b13d-4c89-9b2f-3a96a1d4a3dd req-32d51ddf-de38-4c8f-945d-eb5d0eaf28e9 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:28.888333 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-f744b4ce-b13d-4c89-9b2f-3a96a1d4a3dd req-32d51ddf-de38-4c8f-945d-eb5d0eaf28e9 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:28.904390 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-f744b4ce-b13d-4c89-9b2f-3a96a1d4a3dd req-32d51ddf-de38-4c8f-945d-eb5d0eaf28e9 service nova] Creating event network-vif-plugged:da8d102a-c017-4932-bfb8-b3ef13097d11 for instance 93126672-4679-41e5-bfbd-f06836afac17 on hv-cinder-82002 Aug 17 23:51:28.906253 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-4996e160-58f1-4934-9691-5eab647e9d30 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:28.910081 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-f744b4ce-b13d-4c89-9b2f-3a96a1d4a3dd req-32d51ddf-de38-4c8f-945d-eb5d0eaf28e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040646 Aug 17 23:51:28.911238 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 531/1039] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:51:28.916594 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-4996e160-58f1-4934-9691-5eab647e9d30 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e" status: 200 len: 1314 microversion: 2.1 time: 0.174404 Aug 17 23:51:28.924463 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 509/1040] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:28 2022] GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:29.311987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ce571437-fa27-4301-b34d-5ddceaa5df7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:29.312699 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ce571437-fa27-4301-b34d-5ddceaa5df7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:29.318881 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce571437-fa27-4301-b34d-5ddceaa5df7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:29.319446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce571437-fa27-4301-b34d-5ddceaa5df7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:29.319819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce571437-fa27-4301-b34d-5ddceaa5df7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:29.320534 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce571437-fa27-4301-b34d-5ddceaa5df7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:29.321026 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce571437-fa27-4301-b34d-5ddceaa5df7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:29.321461 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce571437-fa27-4301-b34d-5ddceaa5df7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:29.353979 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce571437-fa27-4301-b34d-5ddceaa5df7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:29.354458 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce571437-fa27-4301-b34d-5ddceaa5df7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:29.354890 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce571437-fa27-4301-b34d-5ddceaa5df7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:29.355370 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.objects.instance [None req-ce571437-fa27-4301-b34d-5ddceaa5df7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lazy-loading 'fault' on Instance uuid 16b92554-3f2a-482c-bcf5-1f5f05631227 {{(pid=131394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:51:29.401353 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ce571437-fa27-4301-b34d-5ddceaa5df7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:29.409882 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ce571437-fa27-4301-b34d-5ddceaa5df7b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 200 len: 1325 microversion: 2.1 time: 0.101988 Aug 17 23:51:29.410822 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 532/1041] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:29 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 1325 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:29.939183 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-4e27a179-ddd0-488f-a129-76681a8b78fe tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:29.939812 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-4e27a179-ddd0-488f-a129-76681a8b78fe tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:29.947880 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4e27a179-ddd0-488f-a129-76681a8b78fe tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:29.948396 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4e27a179-ddd0-488f-a129-76681a8b78fe tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:29.948840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4e27a179-ddd0-488f-a129-76681a8b78fe tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:29.950248 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4e27a179-ddd0-488f-a129-76681a8b78fe tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:29.951215 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4e27a179-ddd0-488f-a129-76681a8b78fe tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:29.951874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4e27a179-ddd0-488f-a129-76681a8b78fe tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:30.091167 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-4e27a179-ddd0-488f-a129-76681a8b78fe tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:30.098576 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-4e27a179-ddd0-488f-a129-76681a8b78fe tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e" status: 200 len: 1498 microversion: 2.1 time: 0.164092 Aug 17 23:51:30.099140 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 510/1042] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:29 2022] GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e => generated 1498 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:30.433358 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f8f13122-e90a-4dab-87a2-1a034ae3cb66 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:30.433969 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f8f13122-e90a-4dab-87a2-1a034ae3cb66 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:30.440240 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f8f13122-e90a-4dab-87a2-1a034ae3cb66 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:30.440728 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f8f13122-e90a-4dab-87a2-1a034ae3cb66 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:30.441162 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f8f13122-e90a-4dab-87a2-1a034ae3cb66 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:30.441859 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f8f13122-e90a-4dab-87a2-1a034ae3cb66 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:30.442309 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f8f13122-e90a-4dab-87a2-1a034ae3cb66 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:30.442728 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f8f13122-e90a-4dab-87a2-1a034ae3cb66 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:30.456776 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-f8f13122-e90a-4dab-87a2-1a034ae3cb66 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] HTTP exception thrown: Instance 16b92554-3f2a-482c-bcf5-1f5f05631227 could not be found. Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f8f13122-e90a-4dab-87a2-1a034ae3cb66 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Request method failure captured: Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 HTTP/1.1 Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X2l-q93st1NTKOWUoSNz4uC5L8oWUfPa3jS8JHpAVCeTW1mGbeFoKODaiXZyYRao1BGhnJ20yZaMNbtrUT7msoYDSB3YlpJgfZfhj_Jan1czDnjdIEQUDgH1r4F_6GAdOobnqXI3ykMvGs8YyfATdG7G4drvLh92zHTdTFIEqzq2dY Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: ec8246e3b9904e7a8fe4a04269ab0afe Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-AttachVolumeTestJSON-51062467 Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:51:30.458423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:51:30.460024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ec8246e3b9904e7a8fe4a04269ab0afe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ec8246e3b9904e7a8fe4a04269ab0afe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec8246e3b9904e7a8fe4a04269ab0afe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec8246e3b9904e7a8fe4a04269ab0afe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:51:30.460024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-AttachVolumeTestJSON-51062467 Aug 17 23:51:30.460024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: ec8246e3b9904e7a8fe4a04269ab0afe Aug 17 23:51:30.460024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-AttachVolumeTestJSON-51062467 Aug 17 23:51:30.460024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-AttachVolumeTestJSON-51062467-project Aug 17 23:51:30.460024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:51:30.460024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:51:30.460024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 047293a64a9f4857be1621e77094d367 Aug 17 23:51:30.460024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-AttachVolumeTestJSON-51062467-project Aug 17 23:51:30.460024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:51:30.460024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance 16b92554-3f2a-482c-bcf5-1f5f05631227 could not be found. Aug 17 23:51:30.460024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': '16b92554-3f2a-482c-bcf5-1f5f05631227'} Aug 17 23:51:30.460937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:51:30.460937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:51:30.460937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:51:30.460937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:51:30.460937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:51:30.460937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:51:30.460937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:51:30.460937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:51:30.460937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:51:30.460937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:51:30.460937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16b92554-3f2a-482c-bcf5-1f5f05631227 could not be found. Aug 17 23:51:30.460937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:51:30.460937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:51:30.460937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:51:30.460937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:51:30.460937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:51:30.460937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:51:30.460937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:51:30.460937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:51:30.460937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:51:30.462564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:51:30.462564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:51:30.462564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:51:30.462564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:51:30.462564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:51:30.462564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:51:30.462564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:51:30.462564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16b92554-3f2a-482c-bcf5-1f5f05631227 could not be found. Aug 17 23:51:30.462564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:51:30.462564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:51:30.462564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:51:30.462564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:51:30.462564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:51:30.462564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:51:30.462564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:51:30.462564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:51:30.462564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16b92554-3f2a-482c-bcf5-1f5f05631227 could not be found. Aug 17 23:51:30.462564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:51:30.464370 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f8f13122-e90a-4dab-87a2-1a034ae3cb66 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Returning 404 to user: Instance 16b92554-3f2a-482c-bcf5-1f5f05631227 could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:51:30.464370 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f8f13122-e90a-4dab-87a2-1a034ae3cb66 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 404 len: 111 microversion: 2.1 time: 0.030313 Aug 17 23:51:30.464370 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 533/1043] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:30 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:51:30.469505 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-d2ce824e-ed0f-4537-8f9e-9cccb69a9e09 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '.version_select at 0x7f85fd4b1f70>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:30.487847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-d2ce824e-ed0f-4537-8f9e-9cccb69a9e09 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-269979743" status: 202 len: 0 microversion: 2.1 time: 0.022865 Aug 17 23:51:30.491810 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 511/1044] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Aug 17 23:51:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-269979743 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:51:30.636577 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-57dd4081-0de0-4b0c-8591-9fa879e0e704 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:30.637417 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-57dd4081-0de0-4b0c-8591-9fa879e0e704 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:30.644507 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-57dd4081-0de0-4b0c-8591-9fa879e0e704 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:30.645138 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-57dd4081-0de0-4b0c-8591-9fa879e0e704 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:30.645756 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-57dd4081-0de0-4b0c-8591-9fa879e0e704 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:30.646741 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-57dd4081-0de0-4b0c-8591-9fa879e0e704 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:30.647348 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-57dd4081-0de0-4b0c-8591-9fa879e0e704 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:30.647890 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-57dd4081-0de0-4b0c-8591-9fa879e0e704 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:30.692068 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-57dd4081-0de0-4b0c-8591-9fa879e0e704 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] Going to try to terminate instance {{(pid=131394) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:51:30.779603 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-57dd4081-0de0-4b0c-8591-9fa879e0e704 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e" status: 204 len: 0 microversion: 2.1 time: 0.147280 Aug 17 23:51:30.780400 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 534/1045] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:51:30 2022] DELETE /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 23:51:30.789228 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0892caf6-3200-46fd-8a23-12d27ade442c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:30.789929 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0892caf6-3200-46fd-8a23-12d27ade442c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:30.796279 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0892caf6-3200-46fd-8a23-12d27ade442c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:30.796765 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0892caf6-3200-46fd-8a23-12d27ade442c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:30.797203 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0892caf6-3200-46fd-8a23-12d27ade442c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:30.797905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0892caf6-3200-46fd-8a23-12d27ade442c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:30.798361 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0892caf6-3200-46fd-8a23-12d27ade442c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:30.798791 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0892caf6-3200-46fd-8a23-12d27ade442c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:30.941305 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0892caf6-3200-46fd-8a23-12d27ade442c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:30.949284 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0892caf6-3200-46fd-8a23-12d27ade442c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e" status: 200 len: 1504 microversion: 2.1 time: 0.164277 Aug 17 23:51:30.949865 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 512/1046] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:30 2022] GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:31.156779 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-5374d831-274b-4284-ab56-214c39d51e96 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Action: 'create', calling method: .version_select at 0x7f85fda0a8b0>, body: {"keypair": {"name": "tempest-keypair-371975336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8nE9dbqcNVdDOQb9SGfhqrq+0l6iGz+KYL5TLw5ecie9pYoffvk/AnpQVbdGzCkaRBhXoJLEhHCz0uC5iZ/LKGfbMs9xq05EaWO0PAIXvXIxkeR30Thb4A12gXLFT+eA=="}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:31.172470 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-5374d831-274b-4284-ab56-214c39d51e96 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Getting quotas for project ec8246e3b9904e7a8fe4a04269ab0afe. Resources: {'key_pairs'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:51:31.176303 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-5374d831-274b-4284-ab56-214c39d51e96 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Getting quotas for user 047293a64a9f4857be1621e77094d367 and project ec8246e3b9904e7a8fe4a04269ab0afe. Resources: {'key_pairs'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:51:31.199110 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-5374d831-274b-4284-ab56-214c39d51e96 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046580 Aug 17 23:51:31.199697 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 535/1047] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Aug 17 23:51:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:51:31.971321 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e9b433a4-43db-4563-9b2c-f9bd6adb8fd2 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:31.972016 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e9b433a4-43db-4563-9b2c-f9bd6adb8fd2 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:31.978522 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e9b433a4-43db-4563-9b2c-f9bd6adb8fd2 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:31.979017 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e9b433a4-43db-4563-9b2c-f9bd6adb8fd2 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:31.979513 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e9b433a4-43db-4563-9b2c-f9bd6adb8fd2 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:31.980234 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e9b433a4-43db-4563-9b2c-f9bd6adb8fd2 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:31.980694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e9b433a4-43db-4563-9b2c-f9bd6adb8fd2 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:31.981122 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e9b433a4-43db-4563-9b2c-f9bd6adb8fd2 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:32.191242 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e9b433a4-43db-4563-9b2c-f9bd6adb8fd2 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:32.198939 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e9b433a4-43db-4563-9b2c-f9bd6adb8fd2 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e" status: 200 len: 1504 microversion: 2.1 time: 0.231591 Aug 17 23:51:32.199440 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 513/1048] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:31 2022] GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e => generated 1504 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:32.909957 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8d86c4f0-3fb3-44e6-8776-c1dbc81bc7c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-823826247", "imageRef": "a3cf81e5-e973-4c08-b1da-4e8f104b52a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f5926b6b-855d-424e-99e1-23c773a9098b"}], "security_groups": [{"name": "tempest-securitygroup--1010656370"}], "key_name": "tempest-keypair-371975336", "user_data": "}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:33.014944 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.network.neutron [None req-8d86c4f0-3fb3-44e6-8776-c1dbc81bc7c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] validate_networks() for [('f5926b6b-855d-424e-99e1-23c773a9098b', None, None, None, None, None)] {{(pid=131394) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:51:33.219778 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5a715a10-d18d-4ae8-8445-75eded70ce04 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:33.220418 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5a715a10-d18d-4ae8-8445-75eded70ce04 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:33.222913 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:51:33.229037 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5a715a10-d18d-4ae8-8445-75eded70ce04 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:33.229783 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5a715a10-d18d-4ae8-8445-75eded70ce04 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:33.230393 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5a715a10-d18d-4ae8-8445-75eded70ce04 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:33.231254 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5a715a10-d18d-4ae8-8445-75eded70ce04 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:33.232408 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5a715a10-d18d-4ae8-8445-75eded70ce04 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:33.233178 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5a715a10-d18d-4ae8-8445-75eded70ce04 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:33.391718 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-8d86c4f0-3fb3-44e6-8776-c1dbc81bc7c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Flavor limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:51:33.392296 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-8d86c4f0-3fb3-44e6-8776-c1dbc81bc7c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Image limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:51:33.392839 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-8d86c4f0-3fb3-44e6-8776-c1dbc81bc7c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Flavor pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:51:33.393314 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-8d86c4f0-3fb3-44e6-8776-c1dbc81bc7c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Image pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:51:33.393792 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-8d86c4f0-3fb3-44e6-8776-c1dbc81bc7c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:51:33.402599 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8d86c4f0-3fb3-44e6-8776-c1dbc81bc7c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:33.403083 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8d86c4f0-3fb3-44e6-8776-c1dbc81bc7c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:33.403521 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8d86c4f0-3fb3-44e6-8776-c1dbc81bc7c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:33.404279 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8d86c4f0-3fb3-44e6-8776-c1dbc81bc7c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:33.404737 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8d86c4f0-3fb3-44e6-8776-c1dbc81bc7c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:33.405161 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8d86c4f0-3fb3-44e6-8776-c1dbc81bc7c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:33.422294 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-8d86c4f0-3fb3-44e6-8776-c1dbc81bc7c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Getting quotas for project ec8246e3b9904e7a8fe4a04269ab0afe. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:51:33.426350 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-8d86c4f0-3fb3-44e6-8776-c1dbc81bc7c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Getting quotas for user 047293a64a9f4857be1621e77094d367 and project ec8246e3b9904e7a8fe4a04269ab0afe. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:51:33.436047 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:51:33.440211 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8d86c4f0-3fb3-44e6-8776-c1dbc81bc7c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Going to run 1 instances... {{(pid=131394) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:51:33.444459 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8d86c4f0-3fb3-44e6-8776-c1dbc81bc7c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a3cf81e5-e973-4c08-b1da-4e8f104b52a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131394) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:51:33.495706 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8d86c4f0-3fb3-44e6-8776-c1dbc81bc7c9 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.590584 Aug 17 23:51:33.496746 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 536/1049] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 17 23:51:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 23:51:33.509438 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e6ec4b6c-ddcc-4d8d-88fc-d623d3b1b05d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:33.510653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e6ec4b6c-ddcc-4d8d-88fc-d623d3b1b05d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:33.521242 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5a715a10-d18d-4ae8-8445-75eded70ce04 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:33.532268 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5a715a10-d18d-4ae8-8445-75eded70ce04 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e" status: 200 len: 1504 microversion: 2.1 time: 0.316166 Aug 17 23:51:33.533838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 514/1050] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:33 2022] GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e => generated 1504 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:51:33.581482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e6ec4b6c-ddcc-4d8d-88fc-d623d3b1b05d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:33.588466 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e6ec4b6c-ddcc-4d8d-88fc-d623d3b1b05d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 200 len: 1236 microversion: 2.1 time: 0.084001 Aug 17 23:51:33.589280 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 537/1051] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:33 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 1236 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:51:33.683077 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-5274ee09-9c29-41d3-9709-50db0b45a4a0 req-f8190140-a367-4085-991c-4d1409074eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6afc38f5-a423-4cc8-a9a4-a44ab929fc7e", "name": "network-vif-deleted", "tag": "2228c6b5-9a86-4725-94fd-1c82818bb21f"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:33.696304 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-5274ee09-9c29-41d3-9709-50db0b45a4a0 req-f8190140-a367-4085-991c-4d1409074eda service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:33.697426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-5274ee09-9c29-41d3-9709-50db0b45a4a0 req-f8190140-a367-4085-991c-4d1409074eda service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:33.697853 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-5274ee09-9c29-41d3-9709-50db0b45a4a0 req-f8190140-a367-4085-991c-4d1409074eda service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:33.709735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-5274ee09-9c29-41d3-9709-50db0b45a4a0 req-f8190140-a367-4085-991c-4d1409074eda service nova] Creating event network-vif-deleted:2228c6b5-9a86-4725-94fd-1c82818bb21f for instance 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e on hv-cinder-82002 Aug 17 23:51:33.714406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-5274ee09-9c29-41d3-9709-50db0b45a4a0 req-f8190140-a367-4085-991c-4d1409074eda service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035024 Aug 17 23:51:33.715163 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 515/1052] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:51:34.554110 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-392505c9-d9a5-43ba-9ca7-2f2ff7855362 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:34.554729 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-392505c9-d9a5-43ba-9ca7-2f2ff7855362 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:34.561752 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-392505c9-d9a5-43ba-9ca7-2f2ff7855362 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:34.562241 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-392505c9-d9a5-43ba-9ca7-2f2ff7855362 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:34.562687 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-392505c9-d9a5-43ba-9ca7-2f2ff7855362 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:34.563378 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-392505c9-d9a5-43ba-9ca7-2f2ff7855362 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:34.563838 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-392505c9-d9a5-43ba-9ca7-2f2ff7855362 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:34.564291 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-392505c9-d9a5-43ba-9ca7-2f2ff7855362 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:34.577915 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-392505c9-d9a5-43ba-9ca7-2f2ff7855362 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] HTTP exception thrown: Instance 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e could not be found. Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-392505c9-d9a5-43ba-9ca7-2f2ff7855362 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Request method failure captured: Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e HTTP/1.1 Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X7wMGlNpprmFiUfq34y6Me5OCkK4vqKSagIjQb3Hxm6NHAZWNFA7srkqAxQ2eaEiq-llNWd7a24AQ5vVISA5kvmDruTpRneaRhG72hmAJ8uVc9V_XmKGyfpWyXVNYOvw2c2BeC8Bb1q98ozqdAbk7atA_K-c8vGD0lkNdbzh8ZHnJ4 Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: 2ccde22a7c8a4a9bbfaab1dad9240f34 Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-VolumesActionsTest-978083956 Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:51:34.579545 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:51:34.581164 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2ccde22a7c8a4a9bbfaab1dad9240f34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2ccde22a7c8a4a9bbfaab1dad9240f34", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2ccde22a7c8a4a9bbfaab1dad9240f34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2ccde22a7c8a4a9bbfaab1dad9240f34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:51:34.581164 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-VolumesActionsTest-978083956 Aug 17 23:51:34.581164 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: 2ccde22a7c8a4a9bbfaab1dad9240f34 Aug 17 23:51:34.581164 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-VolumesActionsTest-978083956 Aug 17 23:51:34.581164 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-VolumesActionsTest-978083956-project Aug 17 23:51:34.581164 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:51:34.581164 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:51:34.581164 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 185b05ace78d4e369cb0354a0865fd52 Aug 17 23:51:34.581164 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-VolumesActionsTest-978083956-project Aug 17 23:51:34.581164 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:51:34.581164 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e could not be found. Aug 17 23:51:34.581164 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': '6afc38f5-a423-4cc8-a9a4-a44ab929fc7e'} Aug 17 23:51:34.582020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:51:34.582020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:51:34.582020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:51:34.582020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:51:34.582020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:51:34.582020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:51:34.582020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:51:34.582020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:51:34.582020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:51:34.582020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:51:34.582020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e could not be found. Aug 17 23:51:34.582020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:51:34.582020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:51:34.582020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:51:34.582020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:51:34.582020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:51:34.582020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:51:34.582020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:51:34.582020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:51:34.582020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:51:34.583482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:51:34.583482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:51:34.583482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:51:34.583482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:51:34.583482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:51:34.583482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:51:34.583482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:51:34.583482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e could not be found. Aug 17 23:51:34.583482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:51:34.583482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:51:34.583482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:51:34.583482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:51:34.583482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:51:34.583482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:51:34.583482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:51:34.583482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:51:34.583482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e could not be found. Aug 17 23:51:34.583482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:51:34.584824 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-392505c9-d9a5-43ba-9ca7-2f2ff7855362 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Returning 404 to user: Instance 6afc38f5-a423-4cc8-a9a4-a44ab929fc7e could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:51:34.584824 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-392505c9-d9a5-43ba-9ca7-2f2ff7855362 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e" status: 404 len: 111 microversion: 2.1 time: 0.030762 Aug 17 23:51:34.584824 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 538/1053] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:34 2022] GET /compute/v2.1/servers/6afc38f5-a423-4cc8-a9a4-a44ab929fc7e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:51:34.612199 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f6dfdb9e-a817-4c24-9da8-994710a7e4df tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:34.612903 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f6dfdb9e-a817-4c24-9da8-994710a7e4df tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:34.619040 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f6dfdb9e-a817-4c24-9da8-994710a7e4df tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:34.619527 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f6dfdb9e-a817-4c24-9da8-994710a7e4df tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:34.619991 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f6dfdb9e-a817-4c24-9da8-994710a7e4df tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:34.620685 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f6dfdb9e-a817-4c24-9da8-994710a7e4df tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:34.621145 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f6dfdb9e-a817-4c24-9da8-994710a7e4df tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:34.621570 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f6dfdb9e-a817-4c24-9da8-994710a7e4df tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:34.686488 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-0d3d2486-0d2f-403e-9247-5d3238428cc9 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-822251527", "imageRef": "a3cf81e5-e973-4c08-b1da-4e8f104b52a1", "flavorRef": "452", "networks": [{"uuid": "ae251991-1c50-49af-a7b5-d2ec49964c2b"}]}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:34.688271 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f6dfdb9e-a817-4c24-9da8-994710a7e4df tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:34.695796 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f6dfdb9e-a817-4c24-9da8-994710a7e4df tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 200 len: 1288 microversion: 2.1 time: 0.088236 Aug 17 23:51:34.696379 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 516/1054] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:34 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:34.744937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.network.neutron [None req-0d3d2486-0d2f-403e-9247-5d3238428cc9 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] validate_networks() for [('ae251991-1c50-49af-a7b5-d2ec49964c2b', None, None, None, None, None)] {{(pid=131394) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:51:35.136169 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-0d3d2486-0d2f-403e-9247-5d3238428cc9 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Flavor limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:51:35.136672 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-0d3d2486-0d2f-403e-9247-5d3238428cc9 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Image limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:51:35.137225 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-0d3d2486-0d2f-403e-9247-5d3238428cc9 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Flavor pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:51:35.137712 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-0d3d2486-0d2f-403e-9247-5d3238428cc9 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Image pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:51:35.138304 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-0d3d2486-0d2f-403e-9247-5d3238428cc9 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:51:35.147355 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d3d2486-0d2f-403e-9247-5d3238428cc9 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:35.147921 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d3d2486-0d2f-403e-9247-5d3238428cc9 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:35.148472 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d3d2486-0d2f-403e-9247-5d3238428cc9 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:35.149387 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d3d2486-0d2f-403e-9247-5d3238428cc9 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:35.149915 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d3d2486-0d2f-403e-9247-5d3238428cc9 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:35.150412 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d3d2486-0d2f-403e-9247-5d3238428cc9 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:35.167884 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-0d3d2486-0d2f-403e-9247-5d3238428cc9 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Getting quotas for project 2ccde22a7c8a4a9bbfaab1dad9240f34. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:51:35.172450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-0d3d2486-0d2f-403e-9247-5d3238428cc9 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Getting quotas for user 185b05ace78d4e369cb0354a0865fd52 and project 2ccde22a7c8a4a9bbfaab1dad9240f34. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:51:35.183738 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-0d3d2486-0d2f-403e-9247-5d3238428cc9 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Going to run 1 instances... {{(pid=131394) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:51:35.185966 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-0d3d2486-0d2f-403e-9247-5d3238428cc9 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a3cf81e5-e973-4c08-b1da-4e8f104b52a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131394) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:51:35.232055 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-0d3d2486-0d2f-403e-9247-5d3238428cc9 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550236 Aug 17 23:51:35.233015 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 539/1055] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 17 23:51:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 23:51:35.244688 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-735b0719-d7d9-49ae-9420-eb512e3b823f tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:35.245795 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-735b0719-d7d9-49ae-9420-eb512e3b823f tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:35.353458 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-735b0719-d7d9-49ae-9420-eb512e3b823f tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:35.360689 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-735b0719-d7d9-49ae-9420-eb512e3b823f tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34" status: 200 len: 1213 microversion: 2.1 time: 0.120418 Aug 17 23:51:35.361450 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 517/1056] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:35 2022] GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 => generated 1213 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:35.717899 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-186db23f-0ad9-4138-9e49-4db61b730f0e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:35.718512 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-186db23f-0ad9-4138-9e49-4db61b730f0e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:35.726197 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-186db23f-0ad9-4138-9e49-4db61b730f0e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:35.726681 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-186db23f-0ad9-4138-9e49-4db61b730f0e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:35.727307 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-186db23f-0ad9-4138-9e49-4db61b730f0e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:35.728201 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-186db23f-0ad9-4138-9e49-4db61b730f0e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:35.728651 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-186db23f-0ad9-4138-9e49-4db61b730f0e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:35.729232 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-186db23f-0ad9-4138-9e49-4db61b730f0e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:35.896166 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-186db23f-0ad9-4138-9e49-4db61b730f0e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:35.904395 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-186db23f-0ad9-4138-9e49-4db61b730f0e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 200 len: 1362 microversion: 2.1 time: 0.190813 Aug 17 23:51:35.905137 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 540/1057] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:35 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:36.211781 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-3303d9bb-dc39-418d-b45d-080ef9bb4a0e req-d05675bf-0ba9-4033-9e3e-91494626d83a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eafae50-1872-417f-8a14-b794355d89dd", "tag": "90c98c9b-0cab-4f98-a069-9194887befff"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:36.222025 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-3303d9bb-dc39-418d-b45d-080ef9bb4a0e req-d05675bf-0ba9-4033-9e3e-91494626d83a service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:36.222501 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-3303d9bb-dc39-418d-b45d-080ef9bb4a0e req-d05675bf-0ba9-4033-9e3e-91494626d83a service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:36.222931 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-3303d9bb-dc39-418d-b45d-080ef9bb4a0e req-d05675bf-0ba9-4033-9e3e-91494626d83a service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:36.233667 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-3303d9bb-dc39-418d-b45d-080ef9bb4a0e req-d05675bf-0ba9-4033-9e3e-91494626d83a service nova] Creating event network-changed:90c98c9b-0cab-4f98-a069-9194887befff for instance 7eafae50-1872-417f-8a14-b794355d89dd on hv-cinder-82002 Aug 17 23:51:36.239086 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-3303d9bb-dc39-418d-b45d-080ef9bb4a0e req-d05675bf-0ba9-4033-9e3e-91494626d83a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031057 Aug 17 23:51:36.239684 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 518/1058] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:51:36.381741 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e7502f48-67be-4df1-a69a-13f4788abda6 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:36.382253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e7502f48-67be-4df1-a69a-13f4788abda6 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:36.389018 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e7502f48-67be-4df1-a69a-13f4788abda6 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:36.389511 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e7502f48-67be-4df1-a69a-13f4788abda6 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:36.390023 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e7502f48-67be-4df1-a69a-13f4788abda6 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:36.390733 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e7502f48-67be-4df1-a69a-13f4788abda6 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:36.391205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e7502f48-67be-4df1-a69a-13f4788abda6 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:36.391634 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e7502f48-67be-4df1-a69a-13f4788abda6 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:36.454773 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e7502f48-67be-4df1-a69a-13f4788abda6 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:36.462162 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e7502f48-67be-4df1-a69a-13f4788abda6 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34" status: 200 len: 1265 microversion: 2.1 time: 0.084512 Aug 17 23:51:36.463280 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 541/1059] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:36 2022] GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:36.926146 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1e5453f5-a071-42a4-9d5a-5488597a2d2e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:36.926880 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-1e5453f5-a071-42a4-9d5a-5488597a2d2e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:36.933157 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1e5453f5-a071-42a4-9d5a-5488597a2d2e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:36.933648 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1e5453f5-a071-42a4-9d5a-5488597a2d2e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:36.934788 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1e5453f5-a071-42a4-9d5a-5488597a2d2e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:36.935691 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1e5453f5-a071-42a4-9d5a-5488597a2d2e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:36.936352 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1e5453f5-a071-42a4-9d5a-5488597a2d2e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:36.936795 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1e5453f5-a071-42a4-9d5a-5488597a2d2e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:37.253632 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1e5453f5-a071-42a4-9d5a-5488597a2d2e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:37.261701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-1e5453f5-a071-42a4-9d5a-5488597a2d2e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 200 len: 1362 microversion: 2.1 time: 0.339818 Aug 17 23:51:37.262278 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 519/1060] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:36 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 1362 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:37.484093 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-08d5efdd-3bb7-47f1-96f3-4d617d5c5de0 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:37.484703 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-08d5efdd-3bb7-47f1-96f3-4d617d5c5de0 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:37.491360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08d5efdd-3bb7-47f1-96f3-4d617d5c5de0 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:37.491845 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08d5efdd-3bb7-47f1-96f3-4d617d5c5de0 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:37.492314 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08d5efdd-3bb7-47f1-96f3-4d617d5c5de0 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:37.493005 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08d5efdd-3bb7-47f1-96f3-4d617d5c5de0 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:37.493454 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08d5efdd-3bb7-47f1-96f3-4d617d5c5de0 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:37.493877 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08d5efdd-3bb7-47f1-96f3-4d617d5c5de0 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:37.498919 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:51:37.563003 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-08d5efdd-3bb7-47f1-96f3-4d617d5c5de0 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:37.570502 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-08d5efdd-3bb7-47f1-96f3-4d617d5c5de0 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34" status: 200 len: 1271 microversion: 2.1 time: 0.090318 Aug 17 23:51:37.571058 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 542/1061] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:37 2022] GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:38.283804 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9981c12b-98cb-4dd7-995a-5081bf811e46 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:38.284446 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9981c12b-98cb-4dd7-995a-5081bf811e46 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:38.291223 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9981c12b-98cb-4dd7-995a-5081bf811e46 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:38.291707 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9981c12b-98cb-4dd7-995a-5081bf811e46 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:38.292167 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9981c12b-98cb-4dd7-995a-5081bf811e46 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:38.292857 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9981c12b-98cb-4dd7-995a-5081bf811e46 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:38.293316 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9981c12b-98cb-4dd7-995a-5081bf811e46 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:38.294346 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9981c12b-98cb-4dd7-995a-5081bf811e46 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:38.423464 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9981c12b-98cb-4dd7-995a-5081bf811e46 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:38.430804 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9981c12b-98cb-4dd7-995a-5081bf811e46 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 200 len: 1362 microversion: 2.1 time: 0.150928 Aug 17 23:51:38.431363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 520/1062] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:38 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:38.591650 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-208f23cb-69ec-47b8-9083-baeff4b35552 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:38.592254 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-208f23cb-69ec-47b8-9083-baeff4b35552 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:38.598775 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-208f23cb-69ec-47b8-9083-baeff4b35552 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:38.599256 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-208f23cb-69ec-47b8-9083-baeff4b35552 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:38.599688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-208f23cb-69ec-47b8-9083-baeff4b35552 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:38.600404 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-208f23cb-69ec-47b8-9083-baeff4b35552 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:38.600856 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-208f23cb-69ec-47b8-9083-baeff4b35552 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:38.601280 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-208f23cb-69ec-47b8-9083-baeff4b35552 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:38.729074 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-208f23cb-69ec-47b8-9083-baeff4b35552 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:38.736453 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-208f23cb-69ec-47b8-9083-baeff4b35552 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34" status: 200 len: 1313 microversion: 2.1 time: 0.149313 Aug 17 23:51:38.737009 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 543/1063] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:38 2022] GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:39.450698 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-eeb42647-dac4-4382-990f-00fbbfc7ce9c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:39.451307 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-eeb42647-dac4-4382-990f-00fbbfc7ce9c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:39.457761 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eeb42647-dac4-4382-990f-00fbbfc7ce9c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:39.458238 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eeb42647-dac4-4382-990f-00fbbfc7ce9c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:39.458673 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eeb42647-dac4-4382-990f-00fbbfc7ce9c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:39.459350 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eeb42647-dac4-4382-990f-00fbbfc7ce9c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:39.459803 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eeb42647-dac4-4382-990f-00fbbfc7ce9c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:39.460250 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eeb42647-dac4-4382-990f-00fbbfc7ce9c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:39.586964 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-eeb42647-dac4-4382-990f-00fbbfc7ce9c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:39.594844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-eeb42647-dac4-4382-990f-00fbbfc7ce9c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 200 len: 1362 microversion: 2.1 time: 0.148073 Aug 17 23:51:39.595410 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 521/1064] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:39 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:39.757288 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-743c8038-4c8e-425c-8d59-fe1172cf7c9e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:39.757902 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-743c8038-4c8e-425c-8d59-fe1172cf7c9e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:39.764299 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-743c8038-4c8e-425c-8d59-fe1172cf7c9e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:39.764786 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-743c8038-4c8e-425c-8d59-fe1172cf7c9e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:39.765225 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-743c8038-4c8e-425c-8d59-fe1172cf7c9e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:39.765911 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-743c8038-4c8e-425c-8d59-fe1172cf7c9e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:39.766367 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-743c8038-4c8e-425c-8d59-fe1172cf7c9e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:39.766792 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-743c8038-4c8e-425c-8d59-fe1172cf7c9e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:39.895910 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-743c8038-4c8e-425c-8d59-fe1172cf7c9e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:39.904386 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-743c8038-4c8e-425c-8d59-fe1172cf7c9e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34" status: 200 len: 1313 microversion: 2.1 time: 0.150866 Aug 17 23:51:39.905035 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 544/1065] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:39 2022] GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:40.078368 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-6bdce8b6-1f51-42fb-8a8f-d24595dc07cf tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:40.078779 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-6bdce8b6-1f51-42fb-8a8f-d24595dc07cf tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:40.084930 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6bdce8b6-1f51-42fb-8a8f-d24595dc07cf tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:40.085431 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6bdce8b6-1f51-42fb-8a8f-d24595dc07cf tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:40.085869 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6bdce8b6-1f51-42fb-8a8f-d24595dc07cf tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:40.086556 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6bdce8b6-1f51-42fb-8a8f-d24595dc07cf tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:40.087006 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6bdce8b6-1f51-42fb-8a8f-d24595dc07cf tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:40.087423 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6bdce8b6-1f51-42fb-8a8f-d24595dc07cf tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:40.110748 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-6bdce8b6-1f51-42fb-8a8f-d24595dc07cf tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668/ips" status: 200 len: 150 microversion: 2.1 time: 0.036798 Aug 17 23:51:40.111313 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 522/1066] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Aug 17 23:51:40 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:51:40.616254 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d0112d04-5e89-483c-a09b-98068e76799c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:40.616925 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d0112d04-5e89-483c-a09b-98068e76799c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:40.623431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d0112d04-5e89-483c-a09b-98068e76799c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:40.623911 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d0112d04-5e89-483c-a09b-98068e76799c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:40.624375 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d0112d04-5e89-483c-a09b-98068e76799c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:40.625061 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d0112d04-5e89-483c-a09b-98068e76799c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:40.625508 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d0112d04-5e89-483c-a09b-98068e76799c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:40.625926 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d0112d04-5e89-483c-a09b-98068e76799c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:40.704593 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-f7e6ab0e-f2aa-4bf1-8811-c358088911e4 req-1428f5cf-daac-47ce-bd13-f673e9c71333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1708853-398c-43fe-a9bb-768ed1367e34", "tag": "2989dfea-fe45-4907-8eda-6bed8eb83730"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:40.716882 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-f7e6ab0e-f2aa-4bf1-8811-c358088911e4 req-1428f5cf-daac-47ce-bd13-f673e9c71333 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:40.717456 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-f7e6ab0e-f2aa-4bf1-8811-c358088911e4 req-1428f5cf-daac-47ce-bd13-f673e9c71333 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:40.718170 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-f7e6ab0e-f2aa-4bf1-8811-c358088911e4 req-1428f5cf-daac-47ce-bd13-f673e9c71333 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:40.740168 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-f7e6ab0e-f2aa-4bf1-8811-c358088911e4 req-1428f5cf-daac-47ce-bd13-f673e9c71333 service nova] Creating event network-changed:2989dfea-fe45-4907-8eda-6bed8eb83730 for instance b1708853-398c-43fe-a9bb-768ed1367e34 on hv-cinder-82002 Aug 17 23:51:40.745136 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-f7e6ab0e-f2aa-4bf1-8811-c358088911e4 req-1428f5cf-daac-47ce-bd13-f673e9c71333 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044472 Aug 17 23:51:40.745966 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 523/1067] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:51:40.770259 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d0112d04-5e89-483c-a09b-98068e76799c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:40.778810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d0112d04-5e89-483c-a09b-98068e76799c tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 200 len: 1362 microversion: 2.1 time: 0.166494 Aug 17 23:51:40.779594 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 545/1068] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:40 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:40.926223 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5686ebfa-125f-47f3-9530-6e686c0cd5a5 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:40.926902 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5686ebfa-125f-47f3-9530-6e686c0cd5a5 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:40.933010 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5686ebfa-125f-47f3-9530-6e686c0cd5a5 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:40.933493 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5686ebfa-125f-47f3-9530-6e686c0cd5a5 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:40.933925 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5686ebfa-125f-47f3-9530-6e686c0cd5a5 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:40.935238 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5686ebfa-125f-47f3-9530-6e686c0cd5a5 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:40.935710 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5686ebfa-125f-47f3-9530-6e686c0cd5a5 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:40.936154 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5686ebfa-125f-47f3-9530-6e686c0cd5a5 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:41.157000 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5686ebfa-125f-47f3-9530-6e686c0cd5a5 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:41.164990 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5686ebfa-125f-47f3-9530-6e686c0cd5a5 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34" status: 200 len: 1313 microversion: 2.1 time: 0.242965 Aug 17 23:51:41.165582 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 524/1069] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:40 2022] GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:41.452777 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-4e608d15-3dd3-47f1-9611-dc5eae37445e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9da3dca6-799d-42b4-9cb8-17509ed74b5b"}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:41.455528 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-4e608d15-3dd3-47f1-9611-dc5eae37445e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:41.461621 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4e608d15-3dd3-47f1-9611-dc5eae37445e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:41.462115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4e608d15-3dd3-47f1-9611-dc5eae37445e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:41.462569 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4e608d15-3dd3-47f1-9611-dc5eae37445e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:41.463301 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4e608d15-3dd3-47f1-9611-dc5eae37445e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:41.463765 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4e608d15-3dd3-47f1-9611-dc5eae37445e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:41.464228 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4e608d15-3dd3-47f1-9611-dc5eae37445e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:41.800285 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1f26c4fb-1680-41b8-baea-9cbb88223f9a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:41.800905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-1f26c4fb-1680-41b8-baea-9cbb88223f9a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:41.807174 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1f26c4fb-1680-41b8-baea-9cbb88223f9a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:41.807666 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1f26c4fb-1680-41b8-baea-9cbb88223f9a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:41.808145 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1f26c4fb-1680-41b8-baea-9cbb88223f9a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:41.808851 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1f26c4fb-1680-41b8-baea-9cbb88223f9a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:41.809826 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1f26c4fb-1680-41b8-baea-9cbb88223f9a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:41.810256 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1f26c4fb-1680-41b8-baea-9cbb88223f9a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:41.952946 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1f26c4fb-1680-41b8-baea-9cbb88223f9a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:41.960297 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-1f26c4fb-1680-41b8-baea-9cbb88223f9a tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 200 len: 1362 microversion: 2.1 time: 0.163959 Aug 17 23:51:41.960862 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 525/1070] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:41 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:51:42.186889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-45a2592b-ec4d-4973-b8bf-6d0ed39e6f0e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:42.187505 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-45a2592b-ec4d-4973-b8bf-6d0ed39e6f0e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:42.193422 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-45a2592b-ec4d-4973-b8bf-6d0ed39e6f0e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:42.193905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-45a2592b-ec4d-4973-b8bf-6d0ed39e6f0e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:42.194346 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-45a2592b-ec4d-4973-b8bf-6d0ed39e6f0e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:42.195063 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-45a2592b-ec4d-4973-b8bf-6d0ed39e6f0e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:42.195522 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-45a2592b-ec4d-4973-b8bf-6d0ed39e6f0e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:42.195949 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-45a2592b-ec4d-4973-b8bf-6d0ed39e6f0e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:42.322334 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-45a2592b-ec4d-4973-b8bf-6d0ed39e6f0e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:42.329763 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-45a2592b-ec4d-4973-b8bf-6d0ed39e6f0e tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34" status: 200 len: 1313 microversion: 2.1 time: 0.147640 Aug 17 23:51:42.330329 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 526/1071] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:42 2022] GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:51:42.980954 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e1edf28e-8878-4b6c-a309-a35e8cf73725 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:42.981573 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e1edf28e-8878-4b6c-a309-a35e8cf73725 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:42.987979 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e1edf28e-8878-4b6c-a309-a35e8cf73725 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:42.988483 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e1edf28e-8878-4b6c-a309-a35e8cf73725 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:42.988925 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e1edf28e-8878-4b6c-a309-a35e8cf73725 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:42.989617 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e1edf28e-8878-4b6c-a309-a35e8cf73725 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:42.990078 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e1edf28e-8878-4b6c-a309-a35e8cf73725 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:42.990505 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e1edf28e-8878-4b6c-a309-a35e8cf73725 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:43.008340 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=100 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:51:43.117764 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e1edf28e-8878-4b6c-a309-a35e8cf73725 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:43.125200 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e1edf28e-8878-4b6c-a309-a35e8cf73725 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 200 len: 1362 microversion: 2.1 time: 0.148155 Aug 17 23:51:43.125758 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 527/1072] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:42 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:51:43.350144 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-38b0d38b-af03-4e4a-b9d9-3f36af46038d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:43.350761 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-38b0d38b-af03-4e4a-b9d9-3f36af46038d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:43.356820 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-38b0d38b-af03-4e4a-b9d9-3f36af46038d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:43.357304 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-38b0d38b-af03-4e4a-b9d9-3f36af46038d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:43.357743 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-38b0d38b-af03-4e4a-b9d9-3f36af46038d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:43.358434 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-38b0d38b-af03-4e4a-b9d9-3f36af46038d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:43.358891 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-38b0d38b-af03-4e4a-b9d9-3f36af46038d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:43.359319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-38b0d38b-af03-4e4a-b9d9-3f36af46038d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:43.496949 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-38b0d38b-af03-4e4a-b9d9-3f36af46038d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:43.504417 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-38b0d38b-af03-4e4a-b9d9-3f36af46038d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34" status: 200 len: 1313 microversion: 2.1 time: 0.158091 Aug 17 23:51:43.504976 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 528/1073] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:43 2022] GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:51:43.846118 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-e7c64810-4e56-4a5c-9b74-1ecb74497ec2 req-222b8d4e-92a9-403e-ad26-c229a8db07d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eafae50-1872-417f-8a14-b794355d89dd", "name": "network-vif-plugged", "status": "completed", "tag": "90c98c9b-0cab-4f98-a069-9194887befff"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:43.859661 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-e7c64810-4e56-4a5c-9b74-1ecb74497ec2 req-222b8d4e-92a9-403e-ad26-c229a8db07d7 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:43.860194 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-e7c64810-4e56-4a5c-9b74-1ecb74497ec2 req-222b8d4e-92a9-403e-ad26-c229a8db07d7 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:43.860630 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-e7c64810-4e56-4a5c-9b74-1ecb74497ec2 req-222b8d4e-92a9-403e-ad26-c229a8db07d7 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:43.872719 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-e7c64810-4e56-4a5c-9b74-1ecb74497ec2 req-222b8d4e-92a9-403e-ad26-c229a8db07d7 service nova] Creating event network-vif-plugged:90c98c9b-0cab-4f98-a069-9194887befff for instance 7eafae50-1872-417f-8a14-b794355d89dd on hv-cinder-82002 Aug 17 23:51:43.891937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-e7c64810-4e56-4a5c-9b74-1ecb74497ec2 req-222b8d4e-92a9-403e-ad26-c229a8db07d7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048807 Aug 17 23:51:43.893226 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 529/1074] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:51:44.103025 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-4e608d15-3dd3-47f1-9611-dc5eae37445e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "POST /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.654727 Aug 17 23:51:44.103644 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 546/1075] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 17 23:51:41 2022] POST /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668/os-volume_attachments => generated 194 bytes in 2656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:51:44.148467 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-34d073d2-3687-409c-831e-abde2e465027 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:44.149093 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-34d073d2-3687-409c-831e-abde2e465027 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:44.155646 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-34d073d2-3687-409c-831e-abde2e465027 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:44.156196 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-34d073d2-3687-409c-831e-abde2e465027 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:44.156633 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-34d073d2-3687-409c-831e-abde2e465027 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:44.157788 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-34d073d2-3687-409c-831e-abde2e465027 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:44.158475 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-34d073d2-3687-409c-831e-abde2e465027 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:44.159435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-34d073d2-3687-409c-831e-abde2e465027 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:44.358639 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-34d073d2-3687-409c-831e-abde2e465027 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:44.366298 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-34d073d2-3687-409c-831e-abde2e465027 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 200 len: 1362 microversion: 2.1 time: 0.223043 Aug 17 23:51:44.366876 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 530/1076] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:44 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:44.525824 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9285942c-7f53-4b6a-84f0-29df273bf8f0 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:44.526532 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9285942c-7f53-4b6a-84f0-29df273bf8f0 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:44.532649 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9285942c-7f53-4b6a-84f0-29df273bf8f0 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:44.533135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9285942c-7f53-4b6a-84f0-29df273bf8f0 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:44.533573 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9285942c-7f53-4b6a-84f0-29df273bf8f0 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:44.534275 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9285942c-7f53-4b6a-84f0-29df273bf8f0 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:44.534713 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9285942c-7f53-4b6a-84f0-29df273bf8f0 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:44.535132 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9285942c-7f53-4b6a-84f0-29df273bf8f0 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:44.665968 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9285942c-7f53-4b6a-84f0-29df273bf8f0 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:44.674091 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9285942c-7f53-4b6a-84f0-29df273bf8f0 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34" status: 200 len: 1313 microversion: 2.1 time: 0.152988 Aug 17 23:51:44.674654 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 547/1077] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:44 2022] GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:45.386843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-7b164693-2d03-496a-82fc-5601cf5d452e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:45.387478 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-7b164693-2d03-496a-82fc-5601cf5d452e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:45.390006 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:51:45.396752 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7b164693-2d03-496a-82fc-5601cf5d452e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:45.397244 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7b164693-2d03-496a-82fc-5601cf5d452e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:45.397684 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7b164693-2d03-496a-82fc-5601cf5d452e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:45.398382 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7b164693-2d03-496a-82fc-5601cf5d452e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:45.398844 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7b164693-2d03-496a-82fc-5601cf5d452e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:45.399269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7b164693-2d03-496a-82fc-5601cf5d452e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:45.595314 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7b164693-2d03-496a-82fc-5601cf5d452e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:45.603202 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-7b164693-2d03-496a-82fc-5601cf5d452e tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 200 len: 1362 microversion: 2.1 time: 0.220423 Aug 17 23:51:45.603776 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 531/1078] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:45 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:45.695394 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-af0cdc3b-df0a-480a-9dbe-75667b8c0526 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:45.697749 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-af0cdc3b-df0a-480a-9dbe-75667b8c0526 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:45.700123 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=4 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:51:45.700884 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=18 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:51:45.706881 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af0cdc3b-df0a-480a-9dbe-75667b8c0526 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:45.707309 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af0cdc3b-df0a-480a-9dbe-75667b8c0526 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:45.707747 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af0cdc3b-df0a-480a-9dbe-75667b8c0526 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:45.708467 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af0cdc3b-df0a-480a-9dbe-75667b8c0526 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:45.708920 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af0cdc3b-df0a-480a-9dbe-75667b8c0526 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:45.709344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af0cdc3b-df0a-480a-9dbe-75667b8c0526 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:45.854231 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-af0cdc3b-df0a-480a-9dbe-75667b8c0526 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:45.862166 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-af0cdc3b-df0a-480a-9dbe-75667b8c0526 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34" status: 200 len: 1313 microversion: 2.1 time: 0.170591 Aug 17 23:51:45.862736 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 548/1079] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:45 2022] GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:46.626436 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c1b7c37a-dfdf-47cb-9e59-3a8afadb49e6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:46.627083 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c1b7c37a-dfdf-47cb-9e59-3a8afadb49e6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:46.633375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1b7c37a-dfdf-47cb-9e59-3a8afadb49e6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:46.633854 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1b7c37a-dfdf-47cb-9e59-3a8afadb49e6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:46.634291 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1b7c37a-dfdf-47cb-9e59-3a8afadb49e6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:46.634975 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1b7c37a-dfdf-47cb-9e59-3a8afadb49e6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:46.635425 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1b7c37a-dfdf-47cb-9e59-3a8afadb49e6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:46.635846 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c1b7c37a-dfdf-47cb-9e59-3a8afadb49e6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:46.761638 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c1b7c37a-dfdf-47cb-9e59-3a8afadb49e6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:46.769130 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c1b7c37a-dfdf-47cb-9e59-3a8afadb49e6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 200 len: 1548 microversion: 2.1 time: 0.147238 Aug 17 23:51:46.769684 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 532/1080] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:46 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:46.789100 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c9e91bdf-e1af-4297-a45b-2ec0b478a3cd tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:46.789585 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c9e91bdf-e1af-4297-a45b-2ec0b478a3cd tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:46.796386 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c9e91bdf-e1af-4297-a45b-2ec0b478a3cd tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:46.796858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c9e91bdf-e1af-4297-a45b-2ec0b478a3cd tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:46.797286 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c9e91bdf-e1af-4297-a45b-2ec0b478a3cd tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:46.797963 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c9e91bdf-e1af-4297-a45b-2ec0b478a3cd tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:46.798409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c9e91bdf-e1af-4297-a45b-2ec0b478a3cd tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:46.798829 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c9e91bdf-e1af-4297-a45b-2ec0b478a3cd tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:46.880136 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c9e91bdf-e1af-4297-a45b-2ec0b478a3cd tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094995 Aug 17 23:51:46.880717 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 549/1081] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Aug 17 23:51:46 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:51:46.882666 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-857d720f-1592-40c5-b92a-5a1bb413ff83 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:46.883290 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-857d720f-1592-40c5-b92a-5a1bb413ff83 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:46.889278 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-857d720f-1592-40c5-b92a-5a1bb413ff83 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:46.889767 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-857d720f-1592-40c5-b92a-5a1bb413ff83 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:46.890216 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-857d720f-1592-40c5-b92a-5a1bb413ff83 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:46.890916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-857d720f-1592-40c5-b92a-5a1bb413ff83 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:46.891376 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-857d720f-1592-40c5-b92a-5a1bb413ff83 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:46.891806 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-857d720f-1592-40c5-b92a-5a1bb413ff83 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:47.158014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-857d720f-1592-40c5-b92a-5a1bb413ff83 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:47.165741 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-857d720f-1592-40c5-b92a-5a1bb413ff83 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34" status: 200 len: 1313 microversion: 2.1 time: 0.286991 Aug 17 23:51:47.166318 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 533/1082] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:46 2022] GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:51:47.855396 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-e76a2125-e23b-4ec0-89ff-c5e391ce6343 req-469d58a0-7347-43b1-8ec2-b82994002559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1708853-398c-43fe-a9bb-768ed1367e34", "name": "network-vif-plugged", "status": "completed", "tag": "2989dfea-fe45-4907-8eda-6bed8eb83730"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:47.870462 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-e76a2125-e23b-4ec0-89ff-c5e391ce6343 req-469d58a0-7347-43b1-8ec2-b82994002559 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:47.871038 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-e76a2125-e23b-4ec0-89ff-c5e391ce6343 req-469d58a0-7347-43b1-8ec2-b82994002559 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:47.872360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-e76a2125-e23b-4ec0-89ff-c5e391ce6343 req-469d58a0-7347-43b1-8ec2-b82994002559 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:47.885127 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-e76a2125-e23b-4ec0-89ff-c5e391ce6343 req-469d58a0-7347-43b1-8ec2-b82994002559 service nova] Creating event network-vif-plugged:2989dfea-fe45-4907-8eda-6bed8eb83730 for instance b1708853-398c-43fe-a9bb-768ed1367e34 on hv-cinder-82002 Aug 17 23:51:47.894796 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-05edc9f9-3337-4a08-a182-c07e7e7d39d4 req-e8991844-8ea1-4276-a0c4-fcaad7c36147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eafae50-1872-417f-8a14-b794355d89dd", "tag": "90c98c9b-0cab-4f98-a069-9194887befff"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:47.896842 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-e76a2125-e23b-4ec0-89ff-c5e391ce6343 req-469d58a0-7347-43b1-8ec2-b82994002559 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046623 Aug 17 23:51:47.897601 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 550/1083] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:51:47.904828 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-05edc9f9-3337-4a08-a182-c07e7e7d39d4 req-e8991844-8ea1-4276-a0c4-fcaad7c36147 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:47.905315 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-05edc9f9-3337-4a08-a182-c07e7e7d39d4 req-e8991844-8ea1-4276-a0c4-fcaad7c36147 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:47.905752 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-05edc9f9-3337-4a08-a182-c07e7e7d39d4 req-e8991844-8ea1-4276-a0c4-fcaad7c36147 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:47.917150 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-05edc9f9-3337-4a08-a182-c07e7e7d39d4 req-e8991844-8ea1-4276-a0c4-fcaad7c36147 service nova] Creating event network-changed:90c98c9b-0cab-4f98-a069-9194887befff for instance 7eafae50-1872-417f-8a14-b794355d89dd on hv-cinder-82002 Aug 17 23:51:47.922009 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-05edc9f9-3337-4a08-a182-c07e7e7d39d4 req-e8991844-8ea1-4276-a0c4-fcaad7c36147 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030829 Aug 17 23:51:47.922589 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 534/1084] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:51:48.189662 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-11051940-a762-4425-89a8-e18364f7c19d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:48.190446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-11051940-a762-4425-89a8-e18364f7c19d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:48.196826 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-11051940-a762-4425-89a8-e18364f7c19d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:48.197387 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-11051940-a762-4425-89a8-e18364f7c19d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:48.197895 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-11051940-a762-4425-89a8-e18364f7c19d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:48.198668 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-11051940-a762-4425-89a8-e18364f7c19d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:48.199231 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-11051940-a762-4425-89a8-e18364f7c19d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:48.199735 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-11051940-a762-4425-89a8-e18364f7c19d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:48.337282 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-11051940-a762-4425-89a8-e18364f7c19d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:48.345324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-11051940-a762-4425-89a8-e18364f7c19d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34" status: 200 len: 1313 microversion: 2.1 time: 0.162076 Aug 17 23:51:48.345888 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 551/1085] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:48 2022] GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:49.367645 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-7d051b76-e189-483e-a401-254ad416f9fa tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:49.368405 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-7d051b76-e189-483e-a401-254ad416f9fa tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:49.374968 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7d051b76-e189-483e-a401-254ad416f9fa tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:49.375449 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7d051b76-e189-483e-a401-254ad416f9fa tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:49.375884 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7d051b76-e189-483e-a401-254ad416f9fa tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:49.376599 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7d051b76-e189-483e-a401-254ad416f9fa tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:49.377053 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7d051b76-e189-483e-a401-254ad416f9fa tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:49.377474 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7d051b76-e189-483e-a401-254ad416f9fa tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:49.581571 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7d051b76-e189-483e-a401-254ad416f9fa tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:49.589086 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-7d051b76-e189-483e-a401-254ad416f9fa tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34" status: 200 len: 1313 microversion: 2.1 time: 0.226177 Aug 17 23:51:49.589654 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 535/1086] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:49 2022] GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:50.609734 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-0d5dd615-4fb7-429c-97af-2d9c61cedb90 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:50.610349 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-0d5dd615-4fb7-429c-97af-2d9c61cedb90 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:50.616828 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d5dd615-4fb7-429c-97af-2d9c61cedb90 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:50.617311 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d5dd615-4fb7-429c-97af-2d9c61cedb90 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:50.617749 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d5dd615-4fb7-429c-97af-2d9c61cedb90 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:50.618433 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d5dd615-4fb7-429c-97af-2d9c61cedb90 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:50.618893 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d5dd615-4fb7-429c-97af-2d9c61cedb90 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:50.619316 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d5dd615-4fb7-429c-97af-2d9c61cedb90 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:50.753754 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0d5dd615-4fb7-429c-97af-2d9c61cedb90 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:50.761348 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-0d5dd615-4fb7-429c-97af-2d9c61cedb90 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34" status: 200 len: 1498 microversion: 2.1 time: 0.155566 Aug 17 23:51:50.761906 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 552/1087] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:50 2022] GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:51.393052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9a08fce9-b2d9-4fa0-8ea2-dcfb561e0690 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:51.393595 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9a08fce9-b2d9-4fa0-8ea2-dcfb561e0690 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:51.400023 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9a08fce9-b2d9-4fa0-8ea2-dcfb561e0690 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:51.400524 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9a08fce9-b2d9-4fa0-8ea2-dcfb561e0690 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:51.400953 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9a08fce9-b2d9-4fa0-8ea2-dcfb561e0690 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:51.401646 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9a08fce9-b2d9-4fa0-8ea2-dcfb561e0690 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:51.402111 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9a08fce9-b2d9-4fa0-8ea2-dcfb561e0690 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:51.402542 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9a08fce9-b2d9-4fa0-8ea2-dcfb561e0690 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:51.427731 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9a08fce9-b2d9-4fa0-8ea2-dcfb561e0690 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Going to try to terminate instance {{(pid=131395) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:51:51.502568 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9a08fce9-b2d9-4fa0-8ea2-dcfb561e0690 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34" status: 204 len: 0 microversion: 2.1 time: 0.113064 Aug 17 23:51:51.503139 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 536/1088] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:51:51 2022] DELETE /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 23:51:51.511214 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-76ba9d0c-04e1-4898-94f1-cff75224211d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:51.511832 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-76ba9d0c-04e1-4898-94f1-cff75224211d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:51.517693 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-76ba9d0c-04e1-4898-94f1-cff75224211d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:51.518179 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-76ba9d0c-04e1-4898-94f1-cff75224211d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:51.518615 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-76ba9d0c-04e1-4898-94f1-cff75224211d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:51.519785 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-76ba9d0c-04e1-4898-94f1-cff75224211d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:51.519785 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-76ba9d0c-04e1-4898-94f1-cff75224211d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:51.520197 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-76ba9d0c-04e1-4898-94f1-cff75224211d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:51.654541 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-76ba9d0c-04e1-4898-94f1-cff75224211d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:51.661997 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-76ba9d0c-04e1-4898-94f1-cff75224211d tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34" status: 200 len: 1504 microversion: 2.1 time: 0.154598 Aug 17 23:51:51.662822 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 553/1089] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:51 2022] GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:52.684659 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-6191ba5a-f365-45c3-81ac-793824d3d71c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:52.685364 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-6191ba5a-f365-45c3-81ac-793824d3d71c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:52.691679 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6191ba5a-f365-45c3-81ac-793824d3d71c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:52.692198 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6191ba5a-f365-45c3-81ac-793824d3d71c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:52.692640 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6191ba5a-f365-45c3-81ac-793824d3d71c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:52.693334 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6191ba5a-f365-45c3-81ac-793824d3d71c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:52.693789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6191ba5a-f365-45c3-81ac-793824d3d71c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:52.694215 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6191ba5a-f365-45c3-81ac-793824d3d71c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:52.824562 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-6191ba5a-f365-45c3-81ac-793824d3d71c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:52.831936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-6191ba5a-f365-45c3-81ac-793824d3d71c tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34" status: 200 len: 1504 microversion: 2.1 time: 0.152087 Aug 17 23:51:52.832525 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 537/1090] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:52 2022] GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:53.746800 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f9d87605-077a-428c-ad3b-ed0acc71e492 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9da3dca6-799d-42b4-9cb8-17509ed74b5b"}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:53.749172 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f9d87605-077a-428c-ad3b-ed0acc71e492 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:53.755543 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f9d87605-077a-428c-ad3b-ed0acc71e492 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:53.756066 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f9d87605-077a-428c-ad3b-ed0acc71e492 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:53.756504 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f9d87605-077a-428c-ad3b-ed0acc71e492 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:53.757190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f9d87605-077a-428c-ad3b-ed0acc71e492 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:53.757644 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f9d87605-077a-428c-ad3b-ed0acc71e492 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:53.758075 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f9d87605-077a-428c-ad3b-ed0acc71e492 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:53.834158 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-f9d87605-077a-428c-ad3b-ed0acc71e492 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] HTTP exception thrown: Invalid volume: volume 9da3dca6-799d-42b4-9cb8-17509ed74b5b is already attached to instances: c039ab07-eda9-4a13-8fd1-faee03623668 Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f9d87605-077a-428c-ad3b-ed0acc71e492 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Request method failure captured: Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: POST /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668/os-volume_attachments HTTP/1.1 Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 74 Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X0aZ0Ay-kH6PfvZI7cy17XlPDvVBNqULzMfSd2lBqPeFYOLCW2B4uA7eGgDIh2gyhJRiaquGwrFB0FR_dzBw5dUqMK9aTJoKgjhkCfhyQeKvg5eOtWGiYm8JdFQIhcHvXQSe7gtpzF6F2XNri6JktJopfvlHW5wMD7P-KZBPLA4s0c Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:51:53.835886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:51:53.837524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/258851d93c2d466a85150116d68441b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_258851d93c2d466a85150116d68441b6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:51:53.837524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:51:53.837524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:51:53.837524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:51:53.837524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:51:53.837524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:51:53.837524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:51:53.837524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 21e06d9bb5a240459ef3298a990a42f2 Aug 17 23:51:53.837524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:51:53.837524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Aug 17 23:51:53.837524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {"volumeAttachment": {"volumeId": "9da3dca6-799d-42b4-9cb8-17509ed74b5b"}} Aug 17 23:51:53.837524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:51:53.838343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Invalid volume: volume 9da3dca6-799d-42b4-9cb8-17509ed74b5b is already attached to instances: c039ab07-eda9-4a13-8fd1-faee03623668 Aug 17 23:51:53.838343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'server_id': 'c039ab07-eda9-4a13-8fd1-faee03623668', 'body': {'volumeAttachment': {'volumeId': '9da3dca6-799d-42b4-9cb8-17509ed74b5b'}}} Aug 17 23:51:53.838343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:51:53.838343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:51:53.838343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 23:51:53.838343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 23:51:53.838343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 23:51:53.838343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 23:51:53.838343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 17 23:51:53.838343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 17 23:51:53.838343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 17 23:51:53.838343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 17 23:51:53.838343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 17 23:51:53.838343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 17 23:51:53.838343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9da3dca6-799d-42b4-9cb8-17509ed74b5b is already attached to instances: c039ab07-eda9-4a13-8fd1-faee03623668 Aug 17 23:51:53.838343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:51:53.838343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:51:53.838343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:51:53.838343 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:51:53.839555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:51:53.839555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:51:53.839555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:51:53.839555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:51:53.839555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:51:53.839555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:51:53.839555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 23:51:53.839555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 23:51:53.839555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 23:51:53.839555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 23:51:53.839555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 23:51:53.839555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 23:51:53.839555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 17 23:51:53.839555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 17 23:51:53.839555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9da3dca6-799d-42b4-9cb8-17509ed74b5b is already attached to instances: c039ab07-eda9-4a13-8fd1-faee03623668 Aug 17 23:51:53.839555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:51:53.839555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:51:53.839555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:51:53.839555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:51:53.839555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:51:53.841582 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:51:53.841582 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:51:53.841582 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:51:53.841582 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9da3dca6-799d-42b4-9cb8-17509ed74b5b is already attached to instances: c039ab07-eda9-4a13-8fd1-faee03623668 Aug 17 23:51:53.841582 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:51:53.841582 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f9d87605-077a-428c-ad3b-ed0acc71e492 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Returning 400 to user: Invalid volume: volume 9da3dca6-799d-42b4-9cb8-17509ed74b5b is already attached to instances: c039ab07-eda9-4a13-8fd1-faee03623668 {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:51:53.841582 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f9d87605-077a-428c-ad3b-ed0acc71e492 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "POST /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094548 Aug 17 23:51:53.841582 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 554/1091] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 17 23:51:53 2022] POST /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 23:51:53.853663 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e17fb1a4-2135-4438-ba88-339b8dac1858 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:53.854272 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e17fb1a4-2135-4438-ba88-339b8dac1858 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:53.861492 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e17fb1a4-2135-4438-ba88-339b8dac1858 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:53.861976 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e17fb1a4-2135-4438-ba88-339b8dac1858 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:53.862410 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e17fb1a4-2135-4438-ba88-339b8dac1858 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:53.863101 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e17fb1a4-2135-4438-ba88-339b8dac1858 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:53.863554 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e17fb1a4-2135-4438-ba88-339b8dac1858 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:53.863995 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e17fb1a4-2135-4438-ba88-339b8dac1858 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:53.903388 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-593ba1fb-aa8d-4514-9585-7e8cb3ad401d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:53.903885 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-593ba1fb-aa8d-4514-9585-7e8cb3ad401d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:53.910044 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-593ba1fb-aa8d-4514-9585-7e8cb3ad401d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:53.911680 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-593ba1fb-aa8d-4514-9585-7e8cb3ad401d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:53.912681 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-593ba1fb-aa8d-4514-9585-7e8cb3ad401d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:53.913154 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-593ba1fb-aa8d-4514-9585-7e8cb3ad401d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:53.913584 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-593ba1fb-aa8d-4514-9585-7e8cb3ad401d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:53.916404 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-593ba1fb-aa8d-4514-9585-7e8cb3ad401d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:53.995360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.objects.instance [None req-593ba1fb-aa8d-4514-9585-7e8cb3ad401d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lazy-loading 'services' on Instance uuid c039ab07-eda9-4a13-8fd1-faee03623668 {{(pid=131394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:51:54.068113 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e17fb1a4-2135-4438-ba88-339b8dac1858 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:54.068306 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-593ba1fb-aa8d-4514-9585-7e8cb3ad401d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668/os-volume_attachments/9da3dca6-799d-42b4-9cb8-17509ed74b5b" status: 202 len: 0 microversion: 2.1 time: 0.168539 Aug 17 23:51:54.068880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 555/1092] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 17 23:51:53 2022] DELETE /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668/os-volume_attachments/9da3dca6-799d-42b4-9cb8-17509ed74b5b => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 23:51:54.078511 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e17fb1a4-2135-4438-ba88-339b8dac1858 tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34" status: 200 len: 1504 microversion: 2.1 time: 0.228699 Aug 17 23:51:54.079314 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-7e05ef92-87d6-4a69-87ff-37936490e20c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:54.080283 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 538/1093] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:53 2022] GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:54.081742 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-7e05ef92-87d6-4a69-87ff-37936490e20c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:54.091378 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7e05ef92-87d6-4a69-87ff-37936490e20c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:54.091874 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7e05ef92-87d6-4a69-87ff-37936490e20c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:54.092347 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7e05ef92-87d6-4a69-87ff-37936490e20c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:54.093049 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7e05ef92-87d6-4a69-87ff-37936490e20c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:54.093627 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7e05ef92-87d6-4a69-87ff-37936490e20c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:54.094051 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7e05ef92-87d6-4a69-87ff-37936490e20c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:54.130437 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-7e05ef92-87d6-4a69-87ff-37936490e20c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056858 Aug 17 23:51:54.131018 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 556/1094] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:51:54 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:51:54.449118 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-02bc636c-6130-470b-b8f7-d5eaafdcb4cc req-ec410408-9153-4625-9faf-f6cac74b8315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1708853-398c-43fe-a9bb-768ed1367e34", "name": "network-vif-deleted", "tag": "2989dfea-fe45-4907-8eda-6bed8eb83730"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:51:54.458400 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-02bc636c-6130-470b-b8f7-d5eaafdcb4cc req-ec410408-9153-4625-9faf-f6cac74b8315 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:54.458877 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-02bc636c-6130-470b-b8f7-d5eaafdcb4cc req-ec410408-9153-4625-9faf-f6cac74b8315 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:54.459307 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-02bc636c-6130-470b-b8f7-d5eaafdcb4cc req-ec410408-9153-4625-9faf-f6cac74b8315 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:54.470719 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-02bc636c-6130-470b-b8f7-d5eaafdcb4cc req-ec410408-9153-4625-9faf-f6cac74b8315 service nova] Creating event network-vif-deleted:2989dfea-fe45-4907-8eda-6bed8eb83730 for instance b1708853-398c-43fe-a9bb-768ed1367e34 on hv-cinder-82002 Aug 17 23:51:54.475502 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-02bc636c-6130-470b-b8f7-d5eaafdcb4cc req-ec410408-9153-4625-9faf-f6cac74b8315 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030063 Aug 17 23:51:54.476098 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 539/1095] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:51:55.100151 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f2e79021-f856-4736-89b5-7053fe3b235b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:55.100764 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f2e79021-f856-4736-89b5-7053fe3b235b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:55.107088 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2e79021-f856-4736-89b5-7053fe3b235b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:55.107573 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2e79021-f856-4736-89b5-7053fe3b235b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:55.108036 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2e79021-f856-4736-89b5-7053fe3b235b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:55.108726 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2e79021-f856-4736-89b5-7053fe3b235b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:55.109182 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2e79021-f856-4736-89b5-7053fe3b235b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:55.109608 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2e79021-f856-4736-89b5-7053fe3b235b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:55.139573 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2e79021-f856-4736-89b5-7053fe3b235b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:55.140076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2e79021-f856-4736-89b5-7053fe3b235b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:55.140514 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2e79021-f856-4736-89b5-7053fe3b235b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:55.140955 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.objects.instance [None req-f2e79021-f856-4736-89b5-7053fe3b235b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lazy-loading 'fault' on Instance uuid b1708853-398c-43fe-a9bb-768ed1367e34 {{(pid=131394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:51:55.143766 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:51:55.144147 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5cc0db58-5db2-40bf-8a92-6e805ca39ecb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:55.146383 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5cc0db58-5db2-40bf-8a92-6e805ca39ecb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:55.152465 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5cc0db58-5db2-40bf-8a92-6e805ca39ecb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:55.152942 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5cc0db58-5db2-40bf-8a92-6e805ca39ecb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:55.153377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5cc0db58-5db2-40bf-8a92-6e805ca39ecb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:55.154098 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5cc0db58-5db2-40bf-8a92-6e805ca39ecb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:55.155112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5cc0db58-5db2-40bf-8a92-6e805ca39ecb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:55.155580 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5cc0db58-5db2-40bf-8a92-6e805ca39ecb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:55.184893 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5cc0db58-5db2-40bf-8a92-6e805ca39ecb tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045377 Aug 17 23:51:55.186182 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 540/1096] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:51:55 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:51:55.187517 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f2e79021-f856-4736-89b5-7053fe3b235b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185b05ace78d4e369cb0354a0865fd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccde22a7c8a4a9bbfaab1dad9240f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:55.195417 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f2e79021-f856-4736-89b5-7053fe3b235b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34" status: 200 len: 1303 microversion: 2.1 time: 0.099172 Aug 17 23:51:55.196279 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 557/1097] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:55 2022] GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:56.197767 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-7609c375-bc7b-4f26-a541-19ca36315e4e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:56.199917 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-7609c375-bc7b-4f26-a541-19ca36315e4e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:56.206382 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7609c375-bc7b-4f26-a541-19ca36315e4e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:56.206859 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7609c375-bc7b-4f26-a541-19ca36315e4e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:56.207289 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7609c375-bc7b-4f26-a541-19ca36315e4e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:56.207980 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7609c375-bc7b-4f26-a541-19ca36315e4e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:56.208450 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7609c375-bc7b-4f26-a541-19ca36315e4e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:56.208872 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7609c375-bc7b-4f26-a541-19ca36315e4e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:56.217253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c803c10c-559e-4f0c-8b30-2ac05c341b3b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:56.217872 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c803c10c-559e-4f0c-8b30-2ac05c341b3b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] [instance: b1708853-398c-43fe-a9bb-768ed1367e34] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:56.224337 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c803c10c-559e-4f0c-8b30-2ac05c341b3b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:56.224838 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c803c10c-559e-4f0c-8b30-2ac05c341b3b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:56.225282 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c803c10c-559e-4f0c-8b30-2ac05c341b3b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:56.225982 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c803c10c-559e-4f0c-8b30-2ac05c341b3b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:56.226443 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c803c10c-559e-4f0c-8b30-2ac05c341b3b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:56.226872 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c803c10c-559e-4f0c-8b30-2ac05c341b3b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:56.238616 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-7609c375-bc7b-4f26-a541-19ca36315e4e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044834 Aug 17 23:51:56.239179 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 541/1098] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:51:56 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-c803c10c-559e-4f0c-8b30-2ac05c341b3b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] HTTP exception thrown: Instance b1708853-398c-43fe-a9bb-768ed1367e34 could not be found. Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c803c10c-559e-4f0c-8b30-2ac05c341b3b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Request method failure captured: Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 HTTP/1.1 Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X7wMGlNpprmFiUfq34y6Me5OCkK4vqKSagIjQb3Hxm6NHAZWNFA7srkqAxQ2eaEiq-llNWd7a24AQ5vVISA5kvmDruTpRneaRhG72hmAJ8uVc9V_XmKGyfpWyXVNYOvw2c2BeC8Bb1q98ozqdAbk7atA_K-c8vGD0lkNdbzh8ZHnJ4 Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: 2ccde22a7c8a4a9bbfaab1dad9240f34 Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-VolumesActionsTest-978083956 Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:51:56.244464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:51:56.246090 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2ccde22a7c8a4a9bbfaab1dad9240f34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2ccde22a7c8a4a9bbfaab1dad9240f34", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2ccde22a7c8a4a9bbfaab1dad9240f34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2ccde22a7c8a4a9bbfaab1dad9240f34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:51:56.246090 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-VolumesActionsTest-978083956 Aug 17 23:51:56.246090 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: 2ccde22a7c8a4a9bbfaab1dad9240f34 Aug 17 23:51:56.246090 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-VolumesActionsTest-978083956 Aug 17 23:51:56.246090 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-VolumesActionsTest-978083956-project Aug 17 23:51:56.246090 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:51:56.246090 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:51:56.246090 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 185b05ace78d4e369cb0354a0865fd52 Aug 17 23:51:56.246090 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-VolumesActionsTest-978083956-project Aug 17 23:51:56.246090 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:51:56.246090 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance b1708853-398c-43fe-a9bb-768ed1367e34 could not be found. Aug 17 23:51:56.246090 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': 'b1708853-398c-43fe-a9bb-768ed1367e34'} Aug 17 23:51:56.247423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:51:56.247423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:51:56.247423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:51:56.247423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:51:56.247423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:51:56.247423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:51:56.247423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:51:56.247423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:51:56.247423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:51:56.247423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:51:56.247423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1708853-398c-43fe-a9bb-768ed1367e34 could not be found. Aug 17 23:51:56.247423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:51:56.247423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:51:56.247423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:51:56.247423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:51:56.247423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:51:56.247423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:51:56.247423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:51:56.247423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:51:56.247423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:51:56.248983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:51:56.248983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:51:56.248983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:51:56.248983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:51:56.248983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:51:56.248983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:51:56.248983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:51:56.248983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1708853-398c-43fe-a9bb-768ed1367e34 could not be found. Aug 17 23:51:56.248983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:51:56.248983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:51:56.248983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:51:56.248983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:51:56.248983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:51:56.248983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:51:56.248983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:51:56.248983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:51:56.248983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1708853-398c-43fe-a9bb-768ed1367e34 could not be found. Aug 17 23:51:56.248983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:51:56.250160 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c803c10c-559e-4f0c-8b30-2ac05c341b3b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] Returning 404 to user: Instance b1708853-398c-43fe-a9bb-768ed1367e34 could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:51:56.250160 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c803c10c-559e-4f0c-8b30-2ac05c341b3b tempest-VolumesActionsTest-978083956 tempest-VolumesActionsTest-978083956-project] 10.222.0.26 "GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34" status: 404 len: 111 microversion: 2.1 time: 0.030834 Aug 17 23:51:56.250160 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 558/1099] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:56 2022] GET /compute/v2.1/servers/b1708853-398c-43fe-a9bb-768ed1367e34 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 23:51:56.304447 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c210a4d2-2756-46e1-b32e-8cec203e2eda tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:56.304942 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c210a4d2-2756-46e1-b32e-8cec203e2eda tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:56.310780 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c210a4d2-2756-46e1-b32e-8cec203e2eda tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:56.311260 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c210a4d2-2756-46e1-b32e-8cec203e2eda tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:56.311690 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c210a4d2-2756-46e1-b32e-8cec203e2eda tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:56.312396 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c210a4d2-2756-46e1-b32e-8cec203e2eda tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:56.312847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c210a4d2-2756-46e1-b32e-8cec203e2eda tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:56.313266 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c210a4d2-2756-46e1-b32e-8cec203e2eda tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:56.339404 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c210a4d2-2756-46e1-b32e-8cec203e2eda tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Going to try to terminate instance {{(pid=131395) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:51:56.390847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:51:56.422792 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c210a4d2-2756-46e1-b32e-8cec203e2eda tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 204 len: 0 microversion: 2.1 time: 0.121059 Aug 17 23:51:56.423896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 542/1100] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:51:56 2022] DELETE /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 23:51:56.438287 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1707b602-a7bb-4dd1-a3ec-5248278fbc94 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:56.438904 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1707b602-a7bb-4dd1-a3ec-5248278fbc94 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:56.444930 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1707b602-a7bb-4dd1-a3ec-5248278fbc94 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:56.445417 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1707b602-a7bb-4dd1-a3ec-5248278fbc94 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:56.446080 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1707b602-a7bb-4dd1-a3ec-5248278fbc94 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:56.446672 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1707b602-a7bb-4dd1-a3ec-5248278fbc94 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:56.447248 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1707b602-a7bb-4dd1-a3ec-5248278fbc94 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:56.447914 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1707b602-a7bb-4dd1-a3ec-5248278fbc94 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:56.585455 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1707b602-a7bb-4dd1-a3ec-5248278fbc94 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:56.593558 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1707b602-a7bb-4dd1-a3ec-5248278fbc94 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1681 microversion: 2.1 time: 0.165051 Aug 17 23:51:56.594113 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 559/1101] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:56 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:57.615888 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9a8ad94f-d71f-4f56-96f6-fdb4e6d93d48 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:57.616613 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9a8ad94f-d71f-4f56-96f6-fdb4e6d93d48 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:57.623096 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9a8ad94f-d71f-4f56-96f6-fdb4e6d93d48 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:57.623582 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9a8ad94f-d71f-4f56-96f6-fdb4e6d93d48 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:57.624047 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9a8ad94f-d71f-4f56-96f6-fdb4e6d93d48 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:57.624735 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9a8ad94f-d71f-4f56-96f6-fdb4e6d93d48 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:57.625220 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9a8ad94f-d71f-4f56-96f6-fdb4e6d93d48 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:57.625639 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9a8ad94f-d71f-4f56-96f6-fdb4e6d93d48 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:57.756931 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9a8ad94f-d71f-4f56-96f6-fdb4e6d93d48 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:57.764332 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9a8ad94f-d71f-4f56-96f6-fdb4e6d93d48 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1681 microversion: 2.1 time: 0.152931 Aug 17 23:51:57.764892 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 543/1102] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:57 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:58.785422 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9ec94869-bdc5-4583-b4c1-2e08bf9caa4c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:58.786064 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9ec94869-bdc5-4583-b4c1-2e08bf9caa4c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:58.792776 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9ec94869-bdc5-4583-b4c1-2e08bf9caa4c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:58.793263 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9ec94869-bdc5-4583-b4c1-2e08bf9caa4c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:58.793703 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9ec94869-bdc5-4583-b4c1-2e08bf9caa4c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:58.794392 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9ec94869-bdc5-4583-b4c1-2e08bf9caa4c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:58.795366 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9ec94869-bdc5-4583-b4c1-2e08bf9caa4c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:58.795763 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9ec94869-bdc5-4583-b4c1-2e08bf9caa4c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:58.923797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9ec94869-bdc5-4583-b4c1-2e08bf9caa4c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:51:58.931506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9ec94869-bdc5-4583-b4c1-2e08bf9caa4c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1681 microversion: 2.1 time: 0.149970 Aug 17 23:51:58.932092 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 560/1103] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:58 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:51:59.953380 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0c5e2d75-9aa7-4b19-993c-ae5c9cd5bb99 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:51:59.953992 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0c5e2d75-9aa7-4b19-993c-ae5c9cd5bb99 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:51:59.960433 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0c5e2d75-9aa7-4b19-993c-ae5c9cd5bb99 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:59.961863 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0c5e2d75-9aa7-4b19-993c-ae5c9cd5bb99 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:59.961863 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0c5e2d75-9aa7-4b19-993c-ae5c9cd5bb99 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:51:59.962121 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0c5e2d75-9aa7-4b19-993c-ae5c9cd5bb99 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:51:59.962457 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0c5e2d75-9aa7-4b19-993c-ae5c9cd5bb99 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:51:59.962877 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0c5e2d75-9aa7-4b19-993c-ae5c9cd5bb99 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:00.094290 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0c5e2d75-9aa7-4b19-993c-ae5c9cd5bb99 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:00.101707 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0c5e2d75-9aa7-4b19-993c-ae5c9cd5bb99 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1681 microversion: 2.1 time: 0.152828 Aug 17 23:52:00.102265 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 544/1104] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:51:59 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:00.761929 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-dda88349-7925-4bc2-98f0-95a6abd581c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:00.762521 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-dda88349-7925-4bc2-98f0-95a6abd581c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:00.769460 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dda88349-7925-4bc2-98f0-95a6abd581c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:00.769945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dda88349-7925-4bc2-98f0-95a6abd581c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:00.770382 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dda88349-7925-4bc2-98f0-95a6abd581c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:00.771072 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dda88349-7925-4bc2-98f0-95a6abd581c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:00.771538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dda88349-7925-4bc2-98f0-95a6abd581c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:00.771980 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dda88349-7925-4bc2-98f0-95a6abd581c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:00.794202 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-dda88349-7925-4bc2-98f0-95a6abd581c1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d/ips" status: 200 len: 150 microversion: 2.20 time: 0.036270 Aug 17 23:52:00.795257 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 561/1105] 10.222.0.26 () {60 vars in 1289 bytes} [Wed Aug 17 23:52:00 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 23:52:01.124316 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b37eba21-e807-4e04-977c-ac854af9ad2f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:01.124945 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b37eba21-e807-4e04-977c-ac854af9ad2f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:01.131382 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b37eba21-e807-4e04-977c-ac854af9ad2f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:01.131872 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b37eba21-e807-4e04-977c-ac854af9ad2f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:01.132342 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b37eba21-e807-4e04-977c-ac854af9ad2f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:01.133036 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b37eba21-e807-4e04-977c-ac854af9ad2f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:01.133490 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b37eba21-e807-4e04-977c-ac854af9ad2f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:01.133915 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b37eba21-e807-4e04-977c-ac854af9ad2f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:01.261193 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b37eba21-e807-4e04-977c-ac854af9ad2f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:01.269239 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b37eba21-e807-4e04-977c-ac854af9ad2f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1681 microversion: 2.1 time: 0.150152 Aug 17 23:52:01.269801 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 545/1106] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:01 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:02.290709 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f5f9c400-b5b5-45ee-9810-564025f090da tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:02.291433 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f5f9c400-b5b5-45ee-9810-564025f090da tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:02.298488 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f5f9c400-b5b5-45ee-9810-564025f090da tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:02.299345 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f5f9c400-b5b5-45ee-9810-564025f090da tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:02.299447 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f5f9c400-b5b5-45ee-9810-564025f090da tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:02.300107 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f5f9c400-b5b5-45ee-9810-564025f090da tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:02.300564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f5f9c400-b5b5-45ee-9810-564025f090da tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:02.300990 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f5f9c400-b5b5-45ee-9810-564025f090da tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:02.436606 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f5f9c400-b5b5-45ee-9810-564025f090da tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:02.444783 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f5f9c400-b5b5-45ee-9810-564025f090da tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1681 microversion: 2.1 time: 0.158150 Aug 17 23:52:02.445365 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 562/1107] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:02 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:03.467188 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b450e043-fa55-48f0-be11-6fe661db2c51 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:03.467821 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b450e043-fa55-48f0-be11-6fe661db2c51 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:03.471898 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:52:03.485878 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b450e043-fa55-48f0-be11-6fe661db2c51 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:03.486593 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b450e043-fa55-48f0-be11-6fe661db2c51 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:03.487051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b450e043-fa55-48f0-be11-6fe661db2c51 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:03.487776 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b450e043-fa55-48f0-be11-6fe661db2c51 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:03.488428 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b450e043-fa55-48f0-be11-6fe661db2c51 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:03.489021 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b450e043-fa55-48f0-be11-6fe661db2c51 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:03.511227 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-506d5c8e-19dd-4ccf-aa72-4afa2773050a req-e1993192-0391-42ea-b893-7a1a80491241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c039ab07-eda9-4a13-8fd1-faee03623668", "name": "network-vif-deleted", "tag": "e29cf50e-a8ec-4776-a56a-132e50191ca7"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:52:03.538155 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:52:03.540451 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-506d5c8e-19dd-4ccf-aa72-4afa2773050a req-e1993192-0391-42ea-b893-7a1a80491241 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:03.545285 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-506d5c8e-19dd-4ccf-aa72-4afa2773050a req-e1993192-0391-42ea-b893-7a1a80491241 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:03.547854 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-506d5c8e-19dd-4ccf-aa72-4afa2773050a req-e1993192-0391-42ea-b893-7a1a80491241 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:03.563882 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-506d5c8e-19dd-4ccf-aa72-4afa2773050a req-e1993192-0391-42ea-b893-7a1a80491241 service nova] Creating event network-vif-deleted:e29cf50e-a8ec-4776-a56a-132e50191ca7 for instance c039ab07-eda9-4a13-8fd1-faee03623668 on hv-cinder-82002 Aug 17 23:52:03.569202 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-506d5c8e-19dd-4ccf-aa72-4afa2773050a req-e1993192-0391-42ea-b893-7a1a80491241 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061693 Aug 17 23:52:03.570424 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 563/1108] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:52:03.646315 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b450e043-fa55-48f0-be11-6fe661db2c51 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:03.661749 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b450e043-fa55-48f0-be11-6fe661db2c51 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1614 microversion: 2.1 time: 0.198596 Aug 17 23:52:03.672569 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 546/1109] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:03 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1614 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:03.775050 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-320ddb35-0c94-46bc-be69-d79a8cc1dab4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:52:03.775631 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-320ddb35-0c94-46bc-be69-d79a8cc1dab4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:03.791663 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-320ddb35-0c94-46bc-be69-d79a8cc1dab4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:03.792169 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-320ddb35-0c94-46bc-be69-d79a8cc1dab4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:03.796711 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-320ddb35-0c94-46bc-be69-d79a8cc1dab4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:03.798794 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-320ddb35-0c94-46bc-be69-d79a8cc1dab4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:03.799441 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-320ddb35-0c94-46bc-be69-d79a8cc1dab4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:03.800813 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-320ddb35-0c94-46bc-be69-d79a8cc1dab4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:03.842491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.objects.instance [None req-320ddb35-0c94-46bc-be69-d79a8cc1dab4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lazy-loading 'flavor' on Instance uuid 011c37dd-ede6-411d-b147-395b6e36ec9d {{(pid=131394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:52:04.127882 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-320ddb35-0c94-46bc-be69-d79a8cc1dab4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "POST /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d/action" status: 202 len: 0 microversion: 2.20 time: 0.357819 Aug 17 23:52:04.129114 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 564/1110] 10.222.0.26 () {62 vars in 1319 bytes} [Wed Aug 17 23:52:03 2022] POST /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 23:52:04.138706 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-24cba245-0b2a-4ca9-abc1-fd88aeb36604 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:04.139825 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-24cba245-0b2a-4ca9-abc1-fd88aeb36604 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:04.153642 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-24cba245-0b2a-4ca9-abc1-fd88aeb36604 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:04.160231 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-24cba245-0b2a-4ca9-abc1-fd88aeb36604 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:04.164520 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-24cba245-0b2a-4ca9-abc1-fd88aeb36604 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:04.165831 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-24cba245-0b2a-4ca9-abc1-fd88aeb36604 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:04.166757 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-24cba245-0b2a-4ca9-abc1-fd88aeb36604 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:04.167525 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-24cba245-0b2a-4ca9-abc1-fd88aeb36604 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:04.359355 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-24cba245-0b2a-4ca9-abc1-fd88aeb36604 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:04.383338 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-24cba245-0b2a-4ca9-abc1-fd88aeb36604 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:04.385802 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-24cba245-0b2a-4ca9-abc1-fd88aeb36604 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:04.387459 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-24cba245-0b2a-4ca9-abc1-fd88aeb36604 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1722 microversion: 2.20 time: 0.253833 Aug 17 23:52:04.406847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 547/1111] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:04 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:04.687418 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-7b3fdd22-d9a9-4f06-8343-2234c83c8c17 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:04.688158 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-7b3fdd22-d9a9-4f06-8343-2234c83c8c17 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:04.705846 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7b3fdd22-d9a9-4f06-8343-2234c83c8c17 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:04.706818 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7b3fdd22-d9a9-4f06-8343-2234c83c8c17 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:04.707679 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7b3fdd22-d9a9-4f06-8343-2234c83c8c17 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:04.708579 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7b3fdd22-d9a9-4f06-8343-2234c83c8c17 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:04.709227 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7b3fdd22-d9a9-4f06-8343-2234c83c8c17 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:04.709746 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7b3fdd22-d9a9-4f06-8343-2234c83c8c17 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:04.769155 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7b3fdd22-d9a9-4f06-8343-2234c83c8c17 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:04.769639 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7b3fdd22-d9a9-4f06-8343-2234c83c8c17 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:04.770669 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7b3fdd22-d9a9-4f06-8343-2234c83c8c17 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:04.771599 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.objects.instance [None req-7b3fdd22-d9a9-4f06-8343-2234c83c8c17 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lazy-loading 'fault' on Instance uuid c039ab07-eda9-4a13-8fd1-faee03623668 {{(pid=131394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:52:04.849585 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-7b3fdd22-d9a9-4f06-8343-2234c83c8c17 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:04.863831 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-7b3fdd22-d9a9-4f06-8343-2234c83c8c17 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 200 len: 1331 microversion: 2.1 time: 0.181975 Aug 17 23:52:04.864451 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 565/1112] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:04 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 1331 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:05.411941 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-76d0c55b-b986-49a8-9b21-6356b88903e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:05.412817 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-76d0c55b-b986-49a8-9b21-6356b88903e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:05.419861 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-76d0c55b-b986-49a8-9b21-6356b88903e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:05.420451 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-76d0c55b-b986-49a8-9b21-6356b88903e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:05.421141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-76d0c55b-b986-49a8-9b21-6356b88903e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:05.421919 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-76d0c55b-b986-49a8-9b21-6356b88903e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:05.422438 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-76d0c55b-b986-49a8-9b21-6356b88903e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:05.422926 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-76d0c55b-b986-49a8-9b21-6356b88903e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:05.570105 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-76d0c55b-b986-49a8-9b21-6356b88903e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:05.579573 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-76d0c55b-b986-49a8-9b21-6356b88903e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:05.581177 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-76d0c55b-b986-49a8-9b21-6356b88903e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:05.582422 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-76d0c55b-b986-49a8-9b21-6356b88903e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1722 microversion: 2.20 time: 0.174366 Aug 17 23:52:05.582980 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 548/1113] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:05 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:52:05.901793 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-bace7390-d6e2-4c1b-b28e-e51e0e801760 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:05.902426 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-bace7390-d6e2-4c1b-b28e-e51e0e801760 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:05.908584 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bace7390-d6e2-4c1b-b28e-e51e0e801760 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:05.909075 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bace7390-d6e2-4c1b-b28e-e51e0e801760 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:05.909517 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bace7390-d6e2-4c1b-b28e-e51e0e801760 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:05.910213 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bace7390-d6e2-4c1b-b28e-e51e0e801760 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:05.910673 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bace7390-d6e2-4c1b-b28e-e51e0e801760 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:05.911103 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bace7390-d6e2-4c1b-b28e-e51e0e801760 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:05.924715 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-bace7390-d6e2-4c1b-b28e-e51e0e801760 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] HTTP exception thrown: Instance c039ab07-eda9-4a13-8fd1-faee03623668 could not be found. Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-bace7390-d6e2-4c1b-b28e-e51e0e801760 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Request method failure captured: Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 HTTP/1.1 Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X0aZ0Ay-kH6PfvZI7cy17XlPDvVBNqULzMfSd2lBqPeFYOLCW2B4uA7eGgDIh2gyhJRiaquGwrFB0FR_dzBw5dUqMK9aTJoKgjhkCfhyQeKvg5eOtWGiYm8JdFQIhcHvXQSe7gtpzF6F2XNri6JktJopfvlHW5wMD7P-KZBPLA4s0c Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:52:05.926432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:52:05.928032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/258851d93c2d466a85150116d68441b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_258851d93c2d466a85150116d68441b6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:52:05.928032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:52:05.928032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:52:05.928032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:52:05.928032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:52:05.928032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:52:05.928032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:52:05.928032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 21e06d9bb5a240459ef3298a990a42f2 Aug 17 23:52:05.928032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:52:05.928032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:52:05.928032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance c039ab07-eda9-4a13-8fd1-faee03623668 could not be found. Aug 17 23:52:05.928032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': 'c039ab07-eda9-4a13-8fd1-faee03623668'} Aug 17 23:52:05.928974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:52:05.928974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:52:05.928974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:52:05.928974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:52:05.928974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:52:05.928974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:52:05.928974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:52:05.928974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:52:05.928974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:52:05.928974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:52:05.928974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c039ab07-eda9-4a13-8fd1-faee03623668 could not be found. Aug 17 23:52:05.928974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:52:05.928974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:52:05.928974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:52:05.928974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:52:05.928974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:52:05.928974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:52:05.928974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:52:05.928974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:52:05.928974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:52:05.930653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:52:05.930653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:52:05.930653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:52:05.930653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:52:05.930653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:52:05.930653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:52:05.930653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:52:05.930653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c039ab07-eda9-4a13-8fd1-faee03623668 could not be found. Aug 17 23:52:05.930653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:52:05.930653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:52:05.930653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:52:05.930653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:52:05.930653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:52:05.930653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:52:05.930653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:52:05.930653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:52:05.930653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c039ab07-eda9-4a13-8fd1-faee03623668 could not be found. Aug 17 23:52:05.930653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:52:05.932187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-bace7390-d6e2-4c1b-b28e-e51e0e801760 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Returning 404 to user: Instance c039ab07-eda9-4a13-8fd1-faee03623668 could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:52:05.932187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-bace7390-d6e2-4c1b-b28e-e51e0e801760 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 404 len: 111 microversion: 2.1 time: 0.035254 Aug 17 23:52:05.932187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 566/1114] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:05 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:52:05.937328 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f6a9af7b-ede2-4044-9cfb-9452530e386d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '.version_select at 0x7f85fd500310>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:05.960627 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f6a9af7b-ede2-4044-9cfb-9452530e386d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-118982698" status: 202 len: 0 microversion: 2.1 time: 0.027548 Aug 17 23:52:05.961447 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 549/1115] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Aug 17 23:52:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-118982698 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:52:06.610496 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-7049737d-e95d-4ff1-8096-5f1b0f228171 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:06.611248 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-7049737d-e95d-4ff1-8096-5f1b0f228171 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:06.626087 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7049737d-e95d-4ff1-8096-5f1b0f228171 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:06.626646 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7049737d-e95d-4ff1-8096-5f1b0f228171 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:06.627129 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7049737d-e95d-4ff1-8096-5f1b0f228171 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:06.627852 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7049737d-e95d-4ff1-8096-5f1b0f228171 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:06.631557 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7049737d-e95d-4ff1-8096-5f1b0f228171 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:06.632047 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-7049737d-e95d-4ff1-8096-5f1b0f228171 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:06.748834 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-63e9fa35-91bc-4aa0-bc56-6b4338fe53b1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Action: 'create', calling method: .version_select at 0x7f85fda87d30>, body: {"keypair": {"name": "tempest-keypair-391688436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHC69eFNIDOe8sdAlURpmUe7WoQfWQgBwpZFPSOWk4ws9NcSnUBwgQBs1i99y8uptnq9rQATDNLZJ/4GZ4Zq0QTMmxXS1p9TC++WDbmB99kpQN19GLZCg2E2HvgY2Qx8qQ=="}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:52:06.773186 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-63e9fa35-91bc-4aa0-bc56-6b4338fe53b1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Getting quotas for project 258851d93c2d466a85150116d68441b6. Resources: {'key_pairs'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:52:06.780941 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-63e9fa35-91bc-4aa0-bc56-6b4338fe53b1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Getting quotas for user 21e06d9bb5a240459ef3298a990a42f2 and project 258851d93c2d466a85150116d68441b6. Resources: {'key_pairs'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:52:06.805285 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-7049737d-e95d-4ff1-8096-5f1b0f228171 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:06.810748 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-63e9fa35-91bc-4aa0-bc56-6b4338fe53b1 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.066888 Aug 17 23:52:06.812662 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 550/1116] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Aug 17 23:52:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:52:06.814513 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-7049737d-e95d-4ff1-8096-5f1b0f228171 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:06.816129 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-7049737d-e95d-4ff1-8096-5f1b0f228171 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:06.817283 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-7049737d-e95d-4ff1-8096-5f1b0f228171 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1722 microversion: 2.20 time: 0.211368 Aug 17 23:52:06.818943 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 567/1117] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:06 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:07.848213 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-7212e696-7761-44c9-9302-3b0932655b6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:07.849569 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-7212e696-7761-44c9-9302-3b0932655b6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:07.859569 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7212e696-7761-44c9-9302-3b0932655b6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:07.860701 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7212e696-7761-44c9-9302-3b0932655b6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:07.861352 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7212e696-7761-44c9-9302-3b0932655b6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:07.862422 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7212e696-7761-44c9-9302-3b0932655b6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:07.863132 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7212e696-7761-44c9-9302-3b0932655b6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:07.863816 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7212e696-7761-44c9-9302-3b0932655b6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:08.022985 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7212e696-7761-44c9-9302-3b0932655b6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:08.032134 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7212e696-7761-44c9-9302-3b0932655b6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:08.034652 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7212e696-7761-44c9-9302-3b0932655b6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:08.036083 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-7212e696-7761-44c9-9302-3b0932655b6c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1722 microversion: 2.20 time: 0.192706 Aug 17 23:52:08.053784 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 551/1118] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:07 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:08.429659 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-6c772fe0-8a77-4cc3-a5bb-c7c08a5de65f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-345856873", "imageRef": "a3cf81e5-e973-4c08-b1da-4e8f104b52a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1116845-6414-4feb-bcc7-64852b6be391"}], "security_groups": [{"name": "tempest-securitygroup--1222424164"}], "key_name": "tempest-keypair-391688436", "user_data": "}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:52:08.549706 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.network.neutron [None req-6c772fe0-8a77-4cc3-a5bb-c7c08a5de65f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] validate_networks() for [('d1116845-6414-4feb-bcc7-64852b6be391', None, None, None, None, None)] {{(pid=131394) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:52:08.986453 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-6c772fe0-8a77-4cc3-a5bb-c7c08a5de65f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Flavor limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:52:08.987342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-6c772fe0-8a77-4cc3-a5bb-c7c08a5de65f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Image limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:52:08.987973 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-6c772fe0-8a77-4cc3-a5bb-c7c08a5de65f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Flavor pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:52:08.988568 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-6c772fe0-8a77-4cc3-a5bb-c7c08a5de65f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Image pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:52:08.989255 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-6c772fe0-8a77-4cc3-a5bb-c7c08a5de65f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:52:09.001450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6c772fe0-8a77-4cc3-a5bb-c7c08a5de65f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:09.002307 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6c772fe0-8a77-4cc3-a5bb-c7c08a5de65f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:09.003212 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6c772fe0-8a77-4cc3-a5bb-c7c08a5de65f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:09.004599 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6c772fe0-8a77-4cc3-a5bb-c7c08a5de65f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:09.005194 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6c772fe0-8a77-4cc3-a5bb-c7c08a5de65f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:09.005728 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6c772fe0-8a77-4cc3-a5bb-c7c08a5de65f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:09.030446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-6c772fe0-8a77-4cc3-a5bb-c7c08a5de65f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Getting quotas for project 258851d93c2d466a85150116d68441b6. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:52:09.035082 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-6c772fe0-8a77-4cc3-a5bb-c7c08a5de65f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Getting quotas for user 21e06d9bb5a240459ef3298a990a42f2 and project 258851d93c2d466a85150116d68441b6. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:52:09.049968 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-6c772fe0-8a77-4cc3-a5bb-c7c08a5de65f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Going to run 1 instances... {{(pid=131394) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:52:09.052274 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-6c772fe0-8a77-4cc3-a5bb-c7c08a5de65f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a3cf81e5-e973-4c08-b1da-4e8f104b52a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131394) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:52:09.061479 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-d23dda47-0827-4c91-aba2-4eb866563bad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:09.062244 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-d23dda47-0827-4c91-aba2-4eb866563bad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:09.071610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d23dda47-0827-4c91-aba2-4eb866563bad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:09.072512 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d23dda47-0827-4c91-aba2-4eb866563bad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:09.073197 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d23dda47-0827-4c91-aba2-4eb866563bad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:09.074280 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d23dda47-0827-4c91-aba2-4eb866563bad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:09.075040 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d23dda47-0827-4c91-aba2-4eb866563bad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:09.075658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d23dda47-0827-4c91-aba2-4eb866563bad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:09.108989 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-6c772fe0-8a77-4cc3-a5bb-c7c08a5de65f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.683775 Aug 17 23:52:09.116222 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 568/1119] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 17 23:52:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 23:52:09.121770 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f53dea67-0a75-4a81-af7c-1be38848f282 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:09.123245 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f53dea67-0a75-4a81-af7c-1be38848f282 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:09.183261 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f53dea67-0a75-4a81-af7c-1be38848f282 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:09.192916 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f53dea67-0a75-4a81-af7c-1be38848f282 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 200 len: 1240 microversion: 2.1 time: 0.075125 Aug 17 23:52:09.206464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 569/1120] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:09 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:09.284462 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d23dda47-0827-4c91-aba2-4eb866563bad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:09.295484 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d23dda47-0827-4c91-aba2-4eb866563bad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:09.298100 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d23dda47-0827-4c91-aba2-4eb866563bad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:09.299436 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-d23dda47-0827-4c91-aba2-4eb866563bad tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1722 microversion: 2.20 time: 0.243366 Aug 17 23:52:09.312914 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 552/1121] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:09 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:52:10.213214 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-fdba12e8-f1b9-4c56-a830-e4123475cfff tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:10.214619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-fdba12e8-f1b9-4c56-a830-e4123475cfff tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:10.221884 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fdba12e8-f1b9-4c56-a830-e4123475cfff tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:10.222363 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fdba12e8-f1b9-4c56-a830-e4123475cfff tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:10.222974 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fdba12e8-f1b9-4c56-a830-e4123475cfff tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:10.223666 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fdba12e8-f1b9-4c56-a830-e4123475cfff tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:10.225028 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fdba12e8-f1b9-4c56-a830-e4123475cfff tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:10.225617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fdba12e8-f1b9-4c56-a830-e4123475cfff tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:10.291038 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-fdba12e8-f1b9-4c56-a830-e4123475cfff tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:10.299784 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-fdba12e8-f1b9-4c56-a830-e4123475cfff tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 200 len: 1292 microversion: 2.1 time: 0.090449 Aug 17 23:52:10.300609 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 570/1122] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:10 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 1292 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:52:10.329785 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-80ab422f-6f13-4b7f-9f94-a5a8ec7a97b0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:10.331606 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-80ab422f-6f13-4b7f-9f94-a5a8ec7a97b0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:10.339744 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-80ab422f-6f13-4b7f-9f94-a5a8ec7a97b0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:10.340607 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-80ab422f-6f13-4b7f-9f94-a5a8ec7a97b0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:10.341960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-80ab422f-6f13-4b7f-9f94-a5a8ec7a97b0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:10.342865 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-80ab422f-6f13-4b7f-9f94-a5a8ec7a97b0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:10.344166 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-80ab422f-6f13-4b7f-9f94-a5a8ec7a97b0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:10.344590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-80ab422f-6f13-4b7f-9f94-a5a8ec7a97b0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:10.613289 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-80ab422f-6f13-4b7f-9f94-a5a8ec7a97b0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:10.624366 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-80ab422f-6f13-4b7f-9f94-a5a8ec7a97b0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:10.626478 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-80ab422f-6f13-4b7f-9f94-a5a8ec7a97b0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:10.628633 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-80ab422f-6f13-4b7f-9f94-a5a8ec7a97b0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1722 microversion: 2.20 time: 0.306262 Aug 17 23:52:10.644915 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 553/1123] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:10 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1722 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:11.321576 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-42f0b897-b48b-4b3c-b70f-f07cee3beda8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:11.322977 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-42f0b897-b48b-4b3c-b70f-f07cee3beda8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:11.335585 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-42f0b897-b48b-4b3c-b70f-f07cee3beda8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:11.336365 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-42f0b897-b48b-4b3c-b70f-f07cee3beda8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:11.336809 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-42f0b897-b48b-4b3c-b70f-f07cee3beda8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:11.337713 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-42f0b897-b48b-4b3c-b70f-f07cee3beda8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:11.338336 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-42f0b897-b48b-4b3c-b70f-f07cee3beda8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:11.339383 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-42f0b897-b48b-4b3c-b70f-f07cee3beda8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:11.594858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-42f0b897-b48b-4b3c-b70f-f07cee3beda8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:11.607800 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-42f0b897-b48b-4b3c-b70f-f07cee3beda8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 200 len: 1366 microversion: 2.1 time: 0.289331 Aug 17 23:52:11.621766 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 571/1124] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:11 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:11.653818 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-23d27c20-1d2a-4b8d-8fb2-4bd380451ae4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:11.654452 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-23d27c20-1d2a-4b8d-8fb2-4bd380451ae4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:11.662591 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23d27c20-1d2a-4b8d-8fb2-4bd380451ae4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:11.664451 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23d27c20-1d2a-4b8d-8fb2-4bd380451ae4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:11.665246 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23d27c20-1d2a-4b8d-8fb2-4bd380451ae4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:11.666519 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23d27c20-1d2a-4b8d-8fb2-4bd380451ae4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:11.667148 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23d27c20-1d2a-4b8d-8fb2-4bd380451ae4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:11.667744 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23d27c20-1d2a-4b8d-8fb2-4bd380451ae4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:11.930184 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-23d27c20-1d2a-4b8d-8fb2-4bd380451ae4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:11.943327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-23d27c20-1d2a-4b8d-8fb2-4bd380451ae4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:11.945629 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-23d27c20-1d2a-4b8d-8fb2-4bd380451ae4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:11.947114 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-23d27c20-1d2a-4b8d-8fb2-4bd380451ae4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1722 microversion: 2.20 time: 0.298177 Aug 17 23:52:11.961131 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 554/1125] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:11 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1722 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:12.324069 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-07f5f622-a8c8-42c4-b6ad-fcf9f01621d9 req-1c0ded7b-057b-4589-b50e-b8cdb122c3f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1475417e-aa50-4335-8388-b236aab8881f", "tag": "c4b813df-ef3e-473c-a80d-8282f5c9fa39"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:52:12.352571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-07f5f622-a8c8-42c4-b6ad-fcf9f01621d9 req-1c0ded7b-057b-4589-b50e-b8cdb122c3f5 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:12.353060 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-07f5f622-a8c8-42c4-b6ad-fcf9f01621d9 req-1c0ded7b-057b-4589-b50e-b8cdb122c3f5 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:12.357873 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-07f5f622-a8c8-42c4-b6ad-fcf9f01621d9 req-1c0ded7b-057b-4589-b50e-b8cdb122c3f5 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:12.389590 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-07f5f622-a8c8-42c4-b6ad-fcf9f01621d9 req-1c0ded7b-057b-4589-b50e-b8cdb122c3f5 service nova] Creating event network-changed:c4b813df-ef3e-473c-a80d-8282f5c9fa39 for instance 1475417e-aa50-4335-8388-b236aab8881f on hv-cinder-82002 Aug 17 23:52:12.394745 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-07f5f622-a8c8-42c4-b6ad-fcf9f01621d9 req-1c0ded7b-057b-4589-b50e-b8cdb122c3f5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081038 Aug 17 23:52:12.395990 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 572/1126] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:52:12.630324 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2071b413-af06-46df-a3c3-f23d6abc3909 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:12.631128 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2071b413-af06-46df-a3c3-f23d6abc3909 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:12.639582 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2071b413-af06-46df-a3c3-f23d6abc3909 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:12.640252 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2071b413-af06-46df-a3c3-f23d6abc3909 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:12.640951 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2071b413-af06-46df-a3c3-f23d6abc3909 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:12.641907 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2071b413-af06-46df-a3c3-f23d6abc3909 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:12.642489 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2071b413-af06-46df-a3c3-f23d6abc3909 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:12.643014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2071b413-af06-46df-a3c3-f23d6abc3909 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:12.893736 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2071b413-af06-46df-a3c3-f23d6abc3909 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:12.902813 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2071b413-af06-46df-a3c3-f23d6abc3909 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 200 len: 1366 microversion: 2.1 time: 0.276552 Aug 17 23:52:12.906007 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 555/1127] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:12 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:12.976610 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-26191fd9-ea88-4776-a802-bcc6ad9b37c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:12.977787 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-26191fd9-ea88-4776-a802-bcc6ad9b37c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:12.985278 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26191fd9-ea88-4776-a802-bcc6ad9b37c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:12.985849 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26191fd9-ea88-4776-a802-bcc6ad9b37c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:12.986571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26191fd9-ea88-4776-a802-bcc6ad9b37c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:12.988214 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26191fd9-ea88-4776-a802-bcc6ad9b37c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:12.989204 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26191fd9-ea88-4776-a802-bcc6ad9b37c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:12.990026 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-26191fd9-ea88-4776-a802-bcc6ad9b37c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:13.148777 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-26191fd9-ea88-4776-a802-bcc6ad9b37c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:13.157755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-26191fd9-ea88-4776-a802-bcc6ad9b37c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:13.159606 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-26191fd9-ea88-4776-a802-bcc6ad9b37c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:13.161116 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-26191fd9-ea88-4776-a802-bcc6ad9b37c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1722 microversion: 2.20 time: 0.189597 Aug 17 23:52:13.162733 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 573/1128] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:12 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:13.930703 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-d3f6aa08-83f8-434d-9502-c894f0fd1499 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:13.931328 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-d3f6aa08-83f8-434d-9502-c894f0fd1499 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:13.938959 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d3f6aa08-83f8-434d-9502-c894f0fd1499 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:13.939523 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d3f6aa08-83f8-434d-9502-c894f0fd1499 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:13.940228 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d3f6aa08-83f8-434d-9502-c894f0fd1499 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:13.941198 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d3f6aa08-83f8-434d-9502-c894f0fd1499 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:13.941901 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d3f6aa08-83f8-434d-9502-c894f0fd1499 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:13.942570 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d3f6aa08-83f8-434d-9502-c894f0fd1499 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:14.104694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d3f6aa08-83f8-434d-9502-c894f0fd1499 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:14.114064 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-d3f6aa08-83f8-434d-9502-c894f0fd1499 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 200 len: 1366 microversion: 2.1 time: 0.187133 Aug 17 23:52:14.114668 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 556/1129] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:13 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:14.189203 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-38f1c68d-1101-4c5b-8101-0e1e097adea4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:14.189932 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-38f1c68d-1101-4c5b-8101-0e1e097adea4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:14.196514 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-38f1c68d-1101-4c5b-8101-0e1e097adea4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:14.196995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-38f1c68d-1101-4c5b-8101-0e1e097adea4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:14.197616 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-38f1c68d-1101-4c5b-8101-0e1e097adea4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:14.198310 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-38f1c68d-1101-4c5b-8101-0e1e097adea4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:14.198803 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-38f1c68d-1101-4c5b-8101-0e1e097adea4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:14.199227 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-38f1c68d-1101-4c5b-8101-0e1e097adea4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:14.348335 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-38f1c68d-1101-4c5b-8101-0e1e097adea4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:14.360563 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-38f1c68d-1101-4c5b-8101-0e1e097adea4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:14.362381 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-38f1c68d-1101-4c5b-8101-0e1e097adea4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:14.364248 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-38f1c68d-1101-4c5b-8101-0e1e097adea4 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1722 microversion: 2.20 time: 0.178927 Aug 17 23:52:14.366111 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 574/1130] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:14 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:15.135875 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-74c120c9-04dc-4d39-982b-e5ec93ea582a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:15.136633 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-74c120c9-04dc-4d39-982b-e5ec93ea582a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:15.143510 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-74c120c9-04dc-4d39-982b-e5ec93ea582a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:15.144014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-74c120c9-04dc-4d39-982b-e5ec93ea582a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:15.144456 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-74c120c9-04dc-4d39-982b-e5ec93ea582a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:15.145352 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-74c120c9-04dc-4d39-982b-e5ec93ea582a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:15.145802 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-74c120c9-04dc-4d39-982b-e5ec93ea582a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:15.146489 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-74c120c9-04dc-4d39-982b-e5ec93ea582a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:15.291326 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-74c120c9-04dc-4d39-982b-e5ec93ea582a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:15.299912 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-74c120c9-04dc-4d39-982b-e5ec93ea582a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 200 len: 1366 microversion: 2.1 time: 0.168226 Aug 17 23:52:15.300958 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 557/1131] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:15 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:15.388461 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b466c716-8ed2-41c9-a647-56ecd35d50c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:15.389786 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b466c716-8ed2-41c9-a647-56ecd35d50c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:15.399635 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b466c716-8ed2-41c9-a647-56ecd35d50c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:15.400459 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b466c716-8ed2-41c9-a647-56ecd35d50c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:15.401145 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b466c716-8ed2-41c9-a647-56ecd35d50c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:15.402101 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b466c716-8ed2-41c9-a647-56ecd35d50c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:15.402588 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b466c716-8ed2-41c9-a647-56ecd35d50c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:15.403015 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b466c716-8ed2-41c9-a647-56ecd35d50c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:15.559038 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b466c716-8ed2-41c9-a647-56ecd35d50c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:15.566848 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b466c716-8ed2-41c9-a647-56ecd35d50c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:15.568440 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b466c716-8ed2-41c9-a647-56ecd35d50c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:15.569582 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b466c716-8ed2-41c9-a647-56ecd35d50c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1722 microversion: 2.20 time: 0.185126 Aug 17 23:52:15.570336 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 575/1132] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:15 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:16.323997 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ef7bcd9e-ed84-4416-9c54-09f361b59093 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:16.326427 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ef7bcd9e-ed84-4416-9c54-09f361b59093 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:16.340622 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ef7bcd9e-ed84-4416-9c54-09f361b59093 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:16.341425 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ef7bcd9e-ed84-4416-9c54-09f361b59093 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:16.342114 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ef7bcd9e-ed84-4416-9c54-09f361b59093 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:16.343077 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ef7bcd9e-ed84-4416-9c54-09f361b59093 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:16.343749 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ef7bcd9e-ed84-4416-9c54-09f361b59093 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:16.344214 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ef7bcd9e-ed84-4416-9c54-09f361b59093 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:16.520666 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ef7bcd9e-ed84-4416-9c54-09f361b59093 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:16.528599 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ef7bcd9e-ed84-4416-9c54-09f361b59093 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 200 len: 1366 microversion: 2.1 time: 0.210006 Aug 17 23:52:16.529379 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 558/1133] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:16 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:16.593084 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-25653f4a-ca5b-4239-ab7c-d8fe0f589469 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:16.593786 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-25653f4a-ca5b-4239-ab7c-d8fe0f589469 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:16.601009 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-25653f4a-ca5b-4239-ab7c-d8fe0f589469 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:16.601507 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-25653f4a-ca5b-4239-ab7c-d8fe0f589469 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:16.601949 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-25653f4a-ca5b-4239-ab7c-d8fe0f589469 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:16.602673 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-25653f4a-ca5b-4239-ab7c-d8fe0f589469 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:16.603128 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-25653f4a-ca5b-4239-ab7c-d8fe0f589469 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:16.603593 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-25653f4a-ca5b-4239-ab7c-d8fe0f589469 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:16.625618 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:52:16.996794 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-25653f4a-ca5b-4239-ab7c-d8fe0f589469 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:17.005739 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-25653f4a-ca5b-4239-ab7c-d8fe0f589469 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:17.007495 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-25653f4a-ca5b-4239-ab7c-d8fe0f589469 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:17.008849 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-25653f4a-ca5b-4239-ab7c-d8fe0f589469 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1722 microversion: 2.20 time: 0.419946 Aug 17 23:52:17.009901 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 576/1134] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:16 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1722 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:17.551046 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3192f83f-3124-434d-8c39-b0e471978f43 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:17.551672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3192f83f-3124-434d-8c39-b0e471978f43 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:17.553620 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=4 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:52:17.559757 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3192f83f-3124-434d-8c39-b0e471978f43 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:17.560271 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3192f83f-3124-434d-8c39-b0e471978f43 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:17.560724 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3192f83f-3124-434d-8c39-b0e471978f43 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:17.561421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3192f83f-3124-434d-8c39-b0e471978f43 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:17.561889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3192f83f-3124-434d-8c39-b0e471978f43 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:17.562312 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3192f83f-3124-434d-8c39-b0e471978f43 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:17.696123 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3192f83f-3124-434d-8c39-b0e471978f43 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:17.704174 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3192f83f-3124-434d-8c39-b0e471978f43 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 200 len: 1366 microversion: 2.1 time: 0.157769 Aug 17 23:52:17.704795 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 559/1135] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:17 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:18.031293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a616c3db-fa63-4463-be30-8e55acd5e9f0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:18.031941 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a616c3db-fa63-4463-be30-8e55acd5e9f0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:18.038682 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a616c3db-fa63-4463-be30-8e55acd5e9f0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:18.039180 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a616c3db-fa63-4463-be30-8e55acd5e9f0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:18.039803 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a616c3db-fa63-4463-be30-8e55acd5e9f0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:18.040525 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a616c3db-fa63-4463-be30-8e55acd5e9f0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:18.040986 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a616c3db-fa63-4463-be30-8e55acd5e9f0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:18.041417 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a616c3db-fa63-4463-be30-8e55acd5e9f0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:18.173056 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a616c3db-fa63-4463-be30-8e55acd5e9f0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:18.180955 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a616c3db-fa63-4463-be30-8e55acd5e9f0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:18.182468 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a616c3db-fa63-4463-be30-8e55acd5e9f0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:18.183628 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a616c3db-fa63-4463-be30-8e55acd5e9f0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1722 microversion: 2.20 time: 0.156878 Aug 17 23:52:18.184230 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 577/1136] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:18 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:18.724971 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-55a19451-efb4-4d6a-aceb-a1c5dc6203a8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:18.725561 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-55a19451-efb4-4d6a-aceb-a1c5dc6203a8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:18.732602 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-55a19451-efb4-4d6a-aceb-a1c5dc6203a8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:18.733222 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-55a19451-efb4-4d6a-aceb-a1c5dc6203a8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:18.733512 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-55a19451-efb4-4d6a-aceb-a1c5dc6203a8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:18.734281 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-55a19451-efb4-4d6a-aceb-a1c5dc6203a8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:18.734749 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-55a19451-efb4-4d6a-aceb-a1c5dc6203a8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:18.735173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-55a19451-efb4-4d6a-aceb-a1c5dc6203a8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:18.869125 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-55a19451-efb4-4d6a-aceb-a1c5dc6203a8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:18.877254 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-55a19451-efb4-4d6a-aceb-a1c5dc6203a8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 200 len: 1366 microversion: 2.1 time: 0.156310 Aug 17 23:52:18.877804 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 560/1137] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:18 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:19.183907 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-9b018d81-41c4-4153-9745-804482583ef7 req-942fc7c9-6908-4461-95f2-cea67cf00680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1475417e-aa50-4335-8388-b236aab8881f", "name": "network-vif-plugged", "status": "completed", "tag": "c4b813df-ef3e-473c-a80d-8282f5c9fa39"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:52:19.189381 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=2 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:52:19.191943 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=8 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:52:19.197723 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-9b018d81-41c4-4153-9745-804482583ef7 req-942fc7c9-6908-4461-95f2-cea67cf00680 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:19.198203 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-9b018d81-41c4-4153-9745-804482583ef7 req-942fc7c9-6908-4461-95f2-cea67cf00680 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:19.198828 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-9b018d81-41c4-4153-9745-804482583ef7 req-942fc7c9-6908-4461-95f2-cea67cf00680 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:19.206723 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-77f4d4b7-afcc-494e-897a-02a927dbec54 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:19.207599 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-77f4d4b7-afcc-494e-897a-02a927dbec54 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:19.213578 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-9b018d81-41c4-4153-9745-804482583ef7 req-942fc7c9-6908-4461-95f2-cea67cf00680 service nova] Creating event network-vif-plugged:c4b813df-ef3e-473c-a80d-8282f5c9fa39 for instance 1475417e-aa50-4335-8388-b236aab8881f on hv-cinder-82002 Aug 17 23:52:19.213750 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-77f4d4b7-afcc-494e-897a-02a927dbec54 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:19.214116 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-77f4d4b7-afcc-494e-897a-02a927dbec54 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:19.214565 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-77f4d4b7-afcc-494e-897a-02a927dbec54 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:19.215265 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-77f4d4b7-afcc-494e-897a-02a927dbec54 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:19.216365 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-77f4d4b7-afcc-494e-897a-02a927dbec54 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:19.216962 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-77f4d4b7-afcc-494e-897a-02a927dbec54 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:19.219383 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-9b018d81-41c4-4153-9745-804482583ef7 req-942fc7c9-6908-4461-95f2-cea67cf00680 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039426 Aug 17 23:52:19.221085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 578/1138] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:52:19.236593 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=100 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:52:19.358809 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-77f4d4b7-afcc-494e-897a-02a927dbec54 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:19.367567 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-77f4d4b7-afcc-494e-897a-02a927dbec54 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:19.369154 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-77f4d4b7-afcc-494e-897a-02a927dbec54 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:19.370619 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-77f4d4b7-afcc-494e-897a-02a927dbec54 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1722 microversion: 2.20 time: 0.167747 Aug 17 23:52:19.371128 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 561/1139] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:19 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:52:19.899817 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-59ce915c-0124-4041-964a-304c651e2c57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:19.900541 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-59ce915c-0124-4041-964a-304c651e2c57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:19.906764 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-59ce915c-0124-4041-964a-304c651e2c57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:19.907246 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-59ce915c-0124-4041-964a-304c651e2c57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:19.907680 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-59ce915c-0124-4041-964a-304c651e2c57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:19.908412 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-59ce915c-0124-4041-964a-304c651e2c57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:19.908862 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-59ce915c-0124-4041-964a-304c651e2c57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:19.909283 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-59ce915c-0124-4041-964a-304c651e2c57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:20.045827 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-59ce915c-0124-4041-964a-304c651e2c57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:20.053199 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-59ce915c-0124-4041-964a-304c651e2c57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 200 len: 1366 microversion: 2.1 time: 0.157588 Aug 17 23:52:20.053751 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 579/1140] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:19 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:20.394892 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-23cabba0-1b42-4500-a042-d24814d2e17d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:20.395418 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-23cabba0-1b42-4500-a042-d24814d2e17d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:20.401833 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23cabba0-1b42-4500-a042-d24814d2e17d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:20.402318 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23cabba0-1b42-4500-a042-d24814d2e17d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:20.402760 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23cabba0-1b42-4500-a042-d24814d2e17d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:20.404113 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23cabba0-1b42-4500-a042-d24814d2e17d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:20.404572 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23cabba0-1b42-4500-a042-d24814d2e17d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:20.404998 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-23cabba0-1b42-4500-a042-d24814d2e17d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:20.542500 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-23cabba0-1b42-4500-a042-d24814d2e17d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:20.550416 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-23cabba0-1b42-4500-a042-d24814d2e17d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:20.551913 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-23cabba0-1b42-4500-a042-d24814d2e17d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:20.553096 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-23cabba0-1b42-4500-a042-d24814d2e17d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1722 microversion: 2.20 time: 0.162320 Aug 17 23:52:20.553650 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 562/1141] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:20 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:21.073769 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-2f883a16-4c63-4274-9a3a-8958cade94ac tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:21.074376 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-2f883a16-4c63-4274-9a3a-8958cade94ac tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:21.081768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2f883a16-4c63-4274-9a3a-8958cade94ac tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:21.082470 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2f883a16-4c63-4274-9a3a-8958cade94ac tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:21.082914 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2f883a16-4c63-4274-9a3a-8958cade94ac tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:21.083676 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2f883a16-4c63-4274-9a3a-8958cade94ac tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:21.084163 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2f883a16-4c63-4274-9a3a-8958cade94ac tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:21.084759 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2f883a16-4c63-4274-9a3a-8958cade94ac tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:21.226947 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-2f883a16-4c63-4274-9a3a-8958cade94ac tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:21.234886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-2f883a16-4c63-4274-9a3a-8958cade94ac tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 200 len: 1366 microversion: 2.1 time: 0.164904 Aug 17 23:52:21.235448 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 580/1142] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:21 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:21.575829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a610d66b-6b27-4df1-9af1-a440874a8b99 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:21.576469 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a610d66b-6b27-4df1-9af1-a440874a8b99 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:21.582956 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a610d66b-6b27-4df1-9af1-a440874a8b99 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:21.583441 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a610d66b-6b27-4df1-9af1-a440874a8b99 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:21.583876 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a610d66b-6b27-4df1-9af1-a440874a8b99 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:21.584593 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a610d66b-6b27-4df1-9af1-a440874a8b99 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:21.585044 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a610d66b-6b27-4df1-9af1-a440874a8b99 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:21.585467 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a610d66b-6b27-4df1-9af1-a440874a8b99 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:21.715685 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a610d66b-6b27-4df1-9af1-a440874a8b99 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:21.724136 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a610d66b-6b27-4df1-9af1-a440874a8b99 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:21.725662 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a610d66b-6b27-4df1-9af1-a440874a8b99 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:21.726822 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a610d66b-6b27-4df1-9af1-a440874a8b99 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1722 microversion: 2.20 time: 0.155582 Aug 17 23:52:21.727376 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 563/1143] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:21 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:22.255919 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-45b4a573-87e8-4d97-af7c-782cc6eaba69 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:22.256556 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-45b4a573-87e8-4d97-af7c-782cc6eaba69 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:22.262941 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-45b4a573-87e8-4d97-af7c-782cc6eaba69 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:22.263422 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-45b4a573-87e8-4d97-af7c-782cc6eaba69 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:22.263859 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-45b4a573-87e8-4d97-af7c-782cc6eaba69 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:22.264580 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-45b4a573-87e8-4d97-af7c-782cc6eaba69 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:22.265044 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-45b4a573-87e8-4d97-af7c-782cc6eaba69 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:22.265469 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-45b4a573-87e8-4d97-af7c-782cc6eaba69 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:22.393123 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-45b4a573-87e8-4d97-af7c-782cc6eaba69 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:22.400564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-45b4a573-87e8-4d97-af7c-782cc6eaba69 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 200 len: 1555 microversion: 2.1 time: 0.148542 Aug 17 23:52:22.401131 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 581/1144] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:22 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:22.420947 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-d671daad-ba24-4570-b1ee-d70b2bc1ad1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:22.421450 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-d671daad-ba24-4570-b1ee-d70b2bc1ad1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:22.427353 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d671daad-ba24-4570-b1ee-d70b2bc1ad1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:22.427836 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d671daad-ba24-4570-b1ee-d70b2bc1ad1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:22.428307 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d671daad-ba24-4570-b1ee-d70b2bc1ad1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:22.429003 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d671daad-ba24-4570-b1ee-d70b2bc1ad1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:22.429469 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d671daad-ba24-4570-b1ee-d70b2bc1ad1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:22.429899 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d671daad-ba24-4570-b1ee-d70b2bc1ad1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:22.505975 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-d671daad-ba24-4570-b1ee-d70b2bc1ad1a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088821 Aug 17 23:52:22.506570 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 564/1145] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Aug 17 23:52:22 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:52:22.750977 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-5c740ddc-8d56-414b-b3a4-e6a3b6293dc1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:22.751884 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-5c740ddc-8d56-414b-b3a4-e6a3b6293dc1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:22.757806 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5c740ddc-8d56-414b-b3a4-e6a3b6293dc1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:22.758294 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5c740ddc-8d56-414b-b3a4-e6a3b6293dc1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:22.758754 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5c740ddc-8d56-414b-b3a4-e6a3b6293dc1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:22.759430 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5c740ddc-8d56-414b-b3a4-e6a3b6293dc1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:22.759883 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5c740ddc-8d56-414b-b3a4-e6a3b6293dc1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:22.760334 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5c740ddc-8d56-414b-b3a4-e6a3b6293dc1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:22.892036 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5c740ddc-8d56-414b-b3a4-e6a3b6293dc1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:22.899932 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5c740ddc-8d56-414b-b3a4-e6a3b6293dc1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:22.901458 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5c740ddc-8d56-414b-b3a4-e6a3b6293dc1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:22.902612 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-5c740ddc-8d56-414b-b3a4-e6a3b6293dc1 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1743 microversion: 2.20 time: 0.156304 Aug 17 23:52:22.903174 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 582/1146] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:22 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:23.710253 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-34e19632-5e01-4020-8443-e8fd29c7d667 req-50f6babb-2339-407c-8614-5c738fe59949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1475417e-aa50-4335-8388-b236aab8881f", "tag": "c4b813df-ef3e-473c-a80d-8282f5c9fa39"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:52:23.720538 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-34e19632-5e01-4020-8443-e8fd29c7d667 req-50f6babb-2339-407c-8614-5c738fe59949 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:23.721028 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-34e19632-5e01-4020-8443-e8fd29c7d667 req-50f6babb-2339-407c-8614-5c738fe59949 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:23.721580 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-34e19632-5e01-4020-8443-e8fd29c7d667 req-50f6babb-2339-407c-8614-5c738fe59949 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:23.732942 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-34e19632-5e01-4020-8443-e8fd29c7d667 req-50f6babb-2339-407c-8614-5c738fe59949 service nova] Creating event network-changed:c4b813df-ef3e-473c-a80d-8282f5c9fa39 for instance 1475417e-aa50-4335-8388-b236aab8881f on hv-cinder-82002 Aug 17 23:52:23.738237 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-34e19632-5e01-4020-8443-e8fd29c7d667 req-50f6babb-2339-407c-8614-5c738fe59949 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032303 Aug 17 23:52:23.739077 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 565/1147] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:52:23.928126 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e0f824a2-d780-44bf-9cf8-efa60c6bff86 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:23.928757 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e0f824a2-d780-44bf-9cf8-efa60c6bff86 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:23.936018 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e0f824a2-d780-44bf-9cf8-efa60c6bff86 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:23.936727 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e0f824a2-d780-44bf-9cf8-efa60c6bff86 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:23.937341 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e0f824a2-d780-44bf-9cf8-efa60c6bff86 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:23.938057 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e0f824a2-d780-44bf-9cf8-efa60c6bff86 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:23.938523 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e0f824a2-d780-44bf-9cf8-efa60c6bff86 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:23.938953 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e0f824a2-d780-44bf-9cf8-efa60c6bff86 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:24.073577 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e0f824a2-d780-44bf-9cf8-efa60c6bff86 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:24.082565 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e0f824a2-d780-44bf-9cf8-efa60c6bff86 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:24.084109 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e0f824a2-d780-44bf-9cf8-efa60c6bff86 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:24.085298 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e0f824a2-d780-44bf-9cf8-efa60c6bff86 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1743 microversion: 2.20 time: 0.162501 Aug 17 23:52:24.085865 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 583/1148] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:23 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:25.111281 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-652dacde-d697-4f06-a0c3-fac703c423d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:25.112124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-652dacde-d697-4f06-a0c3-fac703c423d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:25.118988 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-652dacde-d697-4f06-a0c3-fac703c423d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:25.119699 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-652dacde-d697-4f06-a0c3-fac703c423d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:25.120183 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-652dacde-d697-4f06-a0c3-fac703c423d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:25.120887 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-652dacde-d697-4f06-a0c3-fac703c423d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:25.121517 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-652dacde-d697-4f06-a0c3-fac703c423d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:25.122517 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-652dacde-d697-4f06-a0c3-fac703c423d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:25.202606 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-946ec48a-2ecc-46fe-b6ca-3f77ac39a8cd req-e3d8f74c-8011-4d37-be4e-ecfd283e9cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011c37dd-ede6-411d-b147-395b6e36ec9d", "name": "network-vif-plugged", "status": "completed", "tag": "1cf07451-1bbc-4e01-a03f-428d2ab9b4b7"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:52:25.212621 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-946ec48a-2ecc-46fe-b6ca-3f77ac39a8cd req-e3d8f74c-8011-4d37-be4e-ecfd283e9cd6 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:25.213403 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-946ec48a-2ecc-46fe-b6ca-3f77ac39a8cd req-e3d8f74c-8011-4d37-be4e-ecfd283e9cd6 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:25.213997 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-946ec48a-2ecc-46fe-b6ca-3f77ac39a8cd req-e3d8f74c-8011-4d37-be4e-ecfd283e9cd6 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:25.234571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-946ec48a-2ecc-46fe-b6ca-3f77ac39a8cd req-e3d8f74c-8011-4d37-be4e-ecfd283e9cd6 service nova] Creating event network-vif-plugged:1cf07451-1bbc-4e01-a03f-428d2ab9b4b7 for instance 011c37dd-ede6-411d-b147-395b6e36ec9d on hv-cinder-82002 Aug 17 23:52:25.240352 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-946ec48a-2ecc-46fe-b6ca-3f77ac39a8cd req-e3d8f74c-8011-4d37-be4e-ecfd283e9cd6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040853 Aug 17 23:52:25.241958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 584/1149] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:52:25.273370 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-652dacde-d697-4f06-a0c3-fac703c423d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:25.283228 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-652dacde-d697-4f06-a0c3-fac703c423d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:25.285259 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-652dacde-d697-4f06-a0c3-fac703c423d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:25.286707 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-652dacde-d697-4f06-a0c3-fac703c423d7 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1743 microversion: 2.20 time: 0.180971 Aug 17 23:52:25.288092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 566/1150] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:25 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1743 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:26.311850 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-4faee2cd-dde1-4924-8d5d-8c8a89f8ee6a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:26.312612 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-4faee2cd-dde1-4924-8d5d-8c8a89f8ee6a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:26.318633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4faee2cd-dde1-4924-8d5d-8c8a89f8ee6a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:26.319121 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4faee2cd-dde1-4924-8d5d-8c8a89f8ee6a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:26.319557 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4faee2cd-dde1-4924-8d5d-8c8a89f8ee6a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:26.320284 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4faee2cd-dde1-4924-8d5d-8c8a89f8ee6a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:26.320739 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4faee2cd-dde1-4924-8d5d-8c8a89f8ee6a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:26.321167 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-4faee2cd-dde1-4924-8d5d-8c8a89f8ee6a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:26.498432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-4faee2cd-dde1-4924-8d5d-8c8a89f8ee6a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:26.506844 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-4faee2cd-dde1-4924-8d5d-8c8a89f8ee6a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:26.508529 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-4faee2cd-dde1-4924-8d5d-8c8a89f8ee6a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:26.510055 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-4faee2cd-dde1-4924-8d5d-8c8a89f8ee6a tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1743 microversion: 2.20 time: 0.203103 Aug 17 23:52:26.510862 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 585/1151] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:26 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:27.533364 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-caa57e6b-6730-4f3d-8d6e-aa568135c9ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:27.533980 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-caa57e6b-6730-4f3d-8d6e-aa568135c9ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:27.540740 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-caa57e6b-6730-4f3d-8d6e-aa568135c9ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:27.541225 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-caa57e6b-6730-4f3d-8d6e-aa568135c9ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:27.541664 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-caa57e6b-6730-4f3d-8d6e-aa568135c9ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:27.542364 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-caa57e6b-6730-4f3d-8d6e-aa568135c9ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:27.542825 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-caa57e6b-6730-4f3d-8d6e-aa568135c9ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:27.543254 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-caa57e6b-6730-4f3d-8d6e-aa568135c9ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:27.669588 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-caa57e6b-6730-4f3d-8d6e-aa568135c9ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:27.677473 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-caa57e6b-6730-4f3d-8d6e-aa568135c9ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:27.678976 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-caa57e6b-6730-4f3d-8d6e-aa568135c9ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:27.680167 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-caa57e6b-6730-4f3d-8d6e-aa568135c9ec tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1743 microversion: 2.20 time: 0.150787 Aug 17 23:52:27.680733 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 567/1152] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:27 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:28.703450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ae39c003-e858-4d75-8aae-42b0ab339268 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:28.704132 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ae39c003-e858-4d75-8aae-42b0ab339268 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:28.710432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ae39c003-e858-4d75-8aae-42b0ab339268 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:28.710906 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ae39c003-e858-4d75-8aae-42b0ab339268 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:28.711333 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ae39c003-e858-4d75-8aae-42b0ab339268 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:28.712036 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ae39c003-e858-4d75-8aae-42b0ab339268 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:28.712486 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ae39c003-e858-4d75-8aae-42b0ab339268 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:28.712905 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ae39c003-e858-4d75-8aae-42b0ab339268 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:28.838591 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ae39c003-e858-4d75-8aae-42b0ab339268 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:28.846444 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ae39c003-e858-4d75-8aae-42b0ab339268 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:28.847933 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ae39c003-e858-4d75-8aae-42b0ab339268 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:28.849099 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ae39c003-e858-4d75-8aae-42b0ab339268 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1743 microversion: 2.20 time: 0.149717 Aug 17 23:52:28.849655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 586/1153] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:28 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:29.147468 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-feb9e12f-03e1-4fd5-a9f0-69048a934073 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1750290394", "imageRef": "a3cf81e5-e973-4c08-b1da-4e8f104b52a1", "flavorRef": "452", "networks": [{"uuid": "8b7f4c6b-06be-41ff-8977-5587b626ca6e"}]}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:52:29.200822 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.network.neutron [None req-feb9e12f-03e1-4fd5-a9f0-69048a934073 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] validate_networks() for [('8b7f4c6b-06be-41ff-8977-5587b626ca6e', None, None, None, None, None)] {{(pid=131395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:52:29.545022 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-feb9e12f-03e1-4fd5-a9f0-69048a934073 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Flavor limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:52:29.545447 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-feb9e12f-03e1-4fd5-a9f0-69048a934073 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Image limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:52:29.545923 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-feb9e12f-03e1-4fd5-a9f0-69048a934073 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Flavor pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:52:29.546333 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-feb9e12f-03e1-4fd5-a9f0-69048a934073 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Image pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:52:29.546745 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-feb9e12f-03e1-4fd5-a9f0-69048a934073 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:52:29.556720 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-feb9e12f-03e1-4fd5-a9f0-69048a934073 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:29.557447 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-feb9e12f-03e1-4fd5-a9f0-69048a934073 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:29.557887 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-feb9e12f-03e1-4fd5-a9f0-69048a934073 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:29.558620 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-feb9e12f-03e1-4fd5-a9f0-69048a934073 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:29.559159 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-feb9e12f-03e1-4fd5-a9f0-69048a934073 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:29.559530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-feb9e12f-03e1-4fd5-a9f0-69048a934073 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:29.577061 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-feb9e12f-03e1-4fd5-a9f0-69048a934073 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Getting quotas for project 190eae26a0d5487882d1c59c337f0db4. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:52:29.581096 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-feb9e12f-03e1-4fd5-a9f0-69048a934073 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Getting quotas for user 64fdf46f185c48558ad1a637898745a9 and project 190eae26a0d5487882d1c59c337f0db4. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:52:29.592786 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-feb9e12f-03e1-4fd5-a9f0-69048a934073 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Going to run 1 instances... {{(pid=131395) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:52:29.595037 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-feb9e12f-03e1-4fd5-a9f0-69048a934073 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a3cf81e5-e973-4c08-b1da-4e8f104b52a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:52:29.639577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-feb9e12f-03e1-4fd5-a9f0-69048a934073 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.495908 Aug 17 23:52:29.640428 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 568/1154] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 17 23:52:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 23:52:29.650705 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-4f908c39-ca08-43cd-af62-bcac18e5a948 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:29.651317 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-4f908c39-ca08-43cd-af62-bcac18e5a948 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:29.714091 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-4f908c39-ca08-43cd-af62-bcac18e5a948 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:29.722681 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-4f908c39-ca08-43cd-af62-bcac18e5a948 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217" status: 200 len: 1219 microversion: 2.1 time: 0.075672 Aug 17 23:52:29.723357 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 587/1155] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:29 2022] GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:29.873611 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1ae1edff-2e60-426d-83dd-a3d0909d8d70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:29.874239 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-1ae1edff-2e60-426d-83dd-a3d0909d8d70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:29.880908 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1ae1edff-2e60-426d-83dd-a3d0909d8d70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:29.881408 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1ae1edff-2e60-426d-83dd-a3d0909d8d70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:29.881858 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1ae1edff-2e60-426d-83dd-a3d0909d8d70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:29.882596 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1ae1edff-2e60-426d-83dd-a3d0909d8d70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:29.883060 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1ae1edff-2e60-426d-83dd-a3d0909d8d70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:29.883493 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1ae1edff-2e60-426d-83dd-a3d0909d8d70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:30.047875 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1ae1edff-2e60-426d-83dd-a3d0909d8d70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:30.063584 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1ae1edff-2e60-426d-83dd-a3d0909d8d70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:30.065748 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1ae1edff-2e60-426d-83dd-a3d0909d8d70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:30.067030 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-1ae1edff-2e60-426d-83dd-a3d0909d8d70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1738 microversion: 2.20 time: 0.197758 Aug 17 23:52:30.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 569/1156] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:29 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:30.744432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-6b3199ab-7b4c-4f04-9616-101541b5d839 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:30.745871 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-6b3199ab-7b4c-4f04-9616-101541b5d839 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:30.753115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6b3199ab-7b4c-4f04-9616-101541b5d839 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:30.754018 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6b3199ab-7b4c-4f04-9616-101541b5d839 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:30.754697 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6b3199ab-7b4c-4f04-9616-101541b5d839 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:30.755629 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6b3199ab-7b4c-4f04-9616-101541b5d839 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:30.756322 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6b3199ab-7b4c-4f04-9616-101541b5d839 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:30.756969 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6b3199ab-7b4c-4f04-9616-101541b5d839 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:30.830049 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-6b3199ab-7b4c-4f04-9616-101541b5d839 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:30.838906 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-6b3199ab-7b4c-4f04-9616-101541b5d839 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217" status: 200 len: 1271 microversion: 2.1 time: 0.098913 Aug 17 23:52:30.839838 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 588/1157] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:30 2022] GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:31.091834 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-bd0bc99a-8337-4a89-af25-4177d3c3f2db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:31.093207 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-bd0bc99a-8337-4a89-af25-4177d3c3f2db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:31.101391 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bd0bc99a-8337-4a89-af25-4177d3c3f2db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:31.127269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bd0bc99a-8337-4a89-af25-4177d3c3f2db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:31.127798 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bd0bc99a-8337-4a89-af25-4177d3c3f2db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:31.128608 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bd0bc99a-8337-4a89-af25-4177d3c3f2db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:31.129090 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bd0bc99a-8337-4a89-af25-4177d3c3f2db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:31.129527 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-bd0bc99a-8337-4a89-af25-4177d3c3f2db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:31.460967 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-bd0bc99a-8337-4a89-af25-4177d3c3f2db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:31.472680 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-bd0bc99a-8337-4a89-af25-4177d3c3f2db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:31.474469 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-bd0bc99a-8337-4a89-af25-4177d3c3f2db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:31.476637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-bd0bc99a-8337-4a89-af25-4177d3c3f2db tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1738 microversion: 2.20 time: 0.388578 Aug 17 23:52:31.491587 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 570/1158] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:31 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1738 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:31.863942 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-15a9444b-3d64-4a38-8091-ce2700dcf638 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:31.864790 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-15a9444b-3d64-4a38-8091-ce2700dcf638 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:31.875661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-15a9444b-3d64-4a38-8091-ce2700dcf638 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:31.876191 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-15a9444b-3d64-4a38-8091-ce2700dcf638 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:31.876949 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-15a9444b-3d64-4a38-8091-ce2700dcf638 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:31.877668 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-15a9444b-3d64-4a38-8091-ce2700dcf638 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:31.878114 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-15a9444b-3d64-4a38-8091-ce2700dcf638 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:31.878598 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-15a9444b-3d64-4a38-8091-ce2700dcf638 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:31.952117 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-15a9444b-3d64-4a38-8091-ce2700dcf638 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:31.961209 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-15a9444b-3d64-4a38-8091-ce2700dcf638 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217" status: 200 len: 1277 microversion: 2.1 time: 0.101570 Aug 17 23:52:31.962297 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 589/1159] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:31 2022] GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217 => generated 1277 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:32.499996 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-7a1e1ad8-6f86-4f9f-a89a-5cc0581f4009 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:32.500795 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-7a1e1ad8-6f86-4f9f-a89a-5cc0581f4009 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:32.509905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7a1e1ad8-6f86-4f9f-a89a-5cc0581f4009 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:32.510775 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7a1e1ad8-6f86-4f9f-a89a-5cc0581f4009 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:32.511250 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7a1e1ad8-6f86-4f9f-a89a-5cc0581f4009 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:32.511995 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7a1e1ad8-6f86-4f9f-a89a-5cc0581f4009 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:32.512460 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7a1e1ad8-6f86-4f9f-a89a-5cc0581f4009 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:32.512894 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7a1e1ad8-6f86-4f9f-a89a-5cc0581f4009 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:32.728530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7a1e1ad8-6f86-4f9f-a89a-5cc0581f4009 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:32.751364 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7a1e1ad8-6f86-4f9f-a89a-5cc0581f4009 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:32.753876 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7a1e1ad8-6f86-4f9f-a89a-5cc0581f4009 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:32.764060 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-7a1e1ad8-6f86-4f9f-a89a-5cc0581f4009 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1738 microversion: 2.20 time: 0.269088 Aug 17 23:52:32.764864 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 571/1160] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:32 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:32.986266 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-52ff3e9e-dfdb-4a72-bb63-13015d906fca tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:32.986760 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-52ff3e9e-dfdb-4a72-bb63-13015d906fca tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:32.999856 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-52ff3e9e-dfdb-4a72-bb63-13015d906fca tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:33.000614 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-52ff3e9e-dfdb-4a72-bb63-13015d906fca tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:33.001151 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-52ff3e9e-dfdb-4a72-bb63-13015d906fca tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:33.001855 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-52ff3e9e-dfdb-4a72-bb63-13015d906fca tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:33.002323 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-52ff3e9e-dfdb-4a72-bb63-13015d906fca tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:33.002756 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-52ff3e9e-dfdb-4a72-bb63-13015d906fca tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:33.021419 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-8e37efba-1304-4f8a-806c-5b1524b32e14 req-1b957c42-bb5b-469f-9b63-048609d8fd26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1edaabd4-258c-42f9-bafb-0c574cd21217", "tag": "230d3f9d-0355-42fd-bd7e-6ee6dca9d675"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:52:33.038257 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-8e37efba-1304-4f8a-806c-5b1524b32e14 req-1b957c42-bb5b-469f-9b63-048609d8fd26 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:33.039457 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-8e37efba-1304-4f8a-806c-5b1524b32e14 req-1b957c42-bb5b-469f-9b63-048609d8fd26 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:33.040883 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-8e37efba-1304-4f8a-806c-5b1524b32e14 req-1b957c42-bb5b-469f-9b63-048609d8fd26 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:33.056787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-8e37efba-1304-4f8a-806c-5b1524b32e14 req-1b957c42-bb5b-469f-9b63-048609d8fd26 service nova] Creating event network-changed:230d3f9d-0355-42fd-bd7e-6ee6dca9d675 for instance 1edaabd4-258c-42f9-bafb-0c574cd21217 on hv-cinder-82002 Aug 17 23:52:33.062316 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-8e37efba-1304-4f8a-806c-5b1524b32e14 req-1b957c42-bb5b-469f-9b63-048609d8fd26 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044886 Aug 17 23:52:33.063393 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 572/1161] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:52:33.172170 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-52ff3e9e-dfdb-4a72-bb63-13015d906fca tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:33.179601 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-52ff3e9e-dfdb-4a72-bb63-13015d906fca tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217" status: 200 len: 1319 microversion: 2.1 time: 0.201387 Aug 17 23:52:33.180202 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 590/1162] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:32 2022] GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:33.790193 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-36848680-d58b-4f71-94b4-47b706b113e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:33.791825 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-36848680-d58b-4f71-94b4-47b706b113e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:33.796012 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:52:33.802398 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-36848680-d58b-4f71-94b4-47b706b113e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:33.803082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-36848680-d58b-4f71-94b4-47b706b113e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:33.803766 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-36848680-d58b-4f71-94b4-47b706b113e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:33.804688 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-36848680-d58b-4f71-94b4-47b706b113e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:33.805138 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-36848680-d58b-4f71-94b4-47b706b113e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:33.805757 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-36848680-d58b-4f71-94b4-47b706b113e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:33.962480 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-36848680-d58b-4f71-94b4-47b706b113e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:33.972309 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-36848680-d58b-4f71-94b4-47b706b113e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:33.973841 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-36848680-d58b-4f71-94b4-47b706b113e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:33.975345 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-36848680-d58b-4f71-94b4-47b706b113e0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1738 microversion: 2.20 time: 0.190801 Aug 17 23:52:33.975924 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 573/1163] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:33 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:34.200340 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d18181c4-f0d5-4090-9fb2-0741e1aea300 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:34.200963 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d18181c4-f0d5-4090-9fb2-0741e1aea300 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:34.203622 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:52:34.209142 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d18181c4-f0d5-4090-9fb2-0741e1aea300 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:34.209867 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d18181c4-f0d5-4090-9fb2-0741e1aea300 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:34.210302 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d18181c4-f0d5-4090-9fb2-0741e1aea300 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:34.210994 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d18181c4-f0d5-4090-9fb2-0741e1aea300 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:34.211443 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d18181c4-f0d5-4090-9fb2-0741e1aea300 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:34.211864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d18181c4-f0d5-4090-9fb2-0741e1aea300 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:34.351215 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d18181c4-f0d5-4090-9fb2-0741e1aea300 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:34.359643 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d18181c4-f0d5-4090-9fb2-0741e1aea300 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217" status: 200 len: 1319 microversion: 2.1 time: 0.163260 Aug 17 23:52:34.363071 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 591/1164] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:34 2022] GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:35.000662 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2a9a7aaa-d3fc-430c-b2ee-f1f06994d417 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:35.001342 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2a9a7aaa-d3fc-430c-b2ee-f1f06994d417 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:35.012874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2a9a7aaa-d3fc-430c-b2ee-f1f06994d417 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:35.013975 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2a9a7aaa-d3fc-430c-b2ee-f1f06994d417 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:35.014424 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2a9a7aaa-d3fc-430c-b2ee-f1f06994d417 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:35.015137 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2a9a7aaa-d3fc-430c-b2ee-f1f06994d417 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:35.015595 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2a9a7aaa-d3fc-430c-b2ee-f1f06994d417 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:35.016046 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2a9a7aaa-d3fc-430c-b2ee-f1f06994d417 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:35.154546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2a9a7aaa-d3fc-430c-b2ee-f1f06994d417 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:35.162995 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2a9a7aaa-d3fc-430c-b2ee-f1f06994d417 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:35.164492 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2a9a7aaa-d3fc-430c-b2ee-f1f06994d417 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:35.165668 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2a9a7aaa-d3fc-430c-b2ee-f1f06994d417 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1738 microversion: 2.20 time: 0.170344 Aug 17 23:52:35.169187 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 574/1165] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:34 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:35.380320 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1edbbde0-deed-4825-be88-4a5f1499e9fc tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:35.381021 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1edbbde0-deed-4825-be88-4a5f1499e9fc tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:35.388721 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1edbbde0-deed-4825-be88-4a5f1499e9fc tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:35.389201 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1edbbde0-deed-4825-be88-4a5f1499e9fc tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:35.389632 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1edbbde0-deed-4825-be88-4a5f1499e9fc tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:35.390320 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1edbbde0-deed-4825-be88-4a5f1499e9fc tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:35.390769 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1edbbde0-deed-4825-be88-4a5f1499e9fc tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:35.391188 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1edbbde0-deed-4825-be88-4a5f1499e9fc tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:35.530014 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1edbbde0-deed-4825-be88-4a5f1499e9fc tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:35.537992 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1edbbde0-deed-4825-be88-4a5f1499e9fc tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217" status: 200 len: 1319 microversion: 2.1 time: 0.161280 Aug 17 23:52:35.538561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 592/1166] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:35 2022] GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:36.189165 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ec7d4a66-f3aa-40c3-823f-1851f0478263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:36.189777 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ec7d4a66-f3aa-40c3-823f-1851f0478263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:36.196295 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ec7d4a66-f3aa-40c3-823f-1851f0478263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:36.196778 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ec7d4a66-f3aa-40c3-823f-1851f0478263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:36.197248 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ec7d4a66-f3aa-40c3-823f-1851f0478263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:36.197943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ec7d4a66-f3aa-40c3-823f-1851f0478263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:36.198399 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ec7d4a66-f3aa-40c3-823f-1851f0478263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:36.198827 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ec7d4a66-f3aa-40c3-823f-1851f0478263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:36.451764 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ec7d4a66-f3aa-40c3-823f-1851f0478263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:36.460689 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ec7d4a66-f3aa-40c3-823f-1851f0478263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:36.462430 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ec7d4a66-f3aa-40c3-823f-1851f0478263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:36.463751 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ec7d4a66-f3aa-40c3-823f-1851f0478263 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1738 microversion: 2.20 time: 0.279263 Aug 17 23:52:36.464525 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 575/1167] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:36 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:36.558675 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d9d51472-18f9-4062-9abf-03c577bcfa56 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:36.559992 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d9d51472-18f9-4062-9abf-03c577bcfa56 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:36.566495 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d9d51472-18f9-4062-9abf-03c577bcfa56 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:36.567295 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d9d51472-18f9-4062-9abf-03c577bcfa56 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:36.567743 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d9d51472-18f9-4062-9abf-03c577bcfa56 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:36.568749 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d9d51472-18f9-4062-9abf-03c577bcfa56 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:36.569405 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d9d51472-18f9-4062-9abf-03c577bcfa56 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:36.570004 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d9d51472-18f9-4062-9abf-03c577bcfa56 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:36.723194 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d9d51472-18f9-4062-9abf-03c577bcfa56 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:36.733175 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d9d51472-18f9-4062-9abf-03c577bcfa56 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217" status: 200 len: 1319 microversion: 2.1 time: 0.178118 Aug 17 23:52:36.734413 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 593/1168] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:36 2022] GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:37.486644 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-14c141e3-b27c-46a1-9d17-ee6114fc61fd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:37.487264 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-14c141e3-b27c-46a1-9d17-ee6114fc61fd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:37.493768 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-14c141e3-b27c-46a1-9d17-ee6114fc61fd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:37.494249 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-14c141e3-b27c-46a1-9d17-ee6114fc61fd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:37.494688 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-14c141e3-b27c-46a1-9d17-ee6114fc61fd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:37.495394 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-14c141e3-b27c-46a1-9d17-ee6114fc61fd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:37.495845 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-14c141e3-b27c-46a1-9d17-ee6114fc61fd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:37.496359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-14c141e3-b27c-46a1-9d17-ee6114fc61fd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:37.644286 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-14c141e3-b27c-46a1-9d17-ee6114fc61fd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:37.654158 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-14c141e3-b27c-46a1-9d17-ee6114fc61fd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:37.655677 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-14c141e3-b27c-46a1-9d17-ee6114fc61fd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:37.656970 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-14c141e3-b27c-46a1-9d17-ee6114fc61fd tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1738 microversion: 2.20 time: 0.174273 Aug 17 23:52:37.657574 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 576/1169] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:37 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:37.754340 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ec51ab36-a859-4598-97e3-9904217985a9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:37.754952 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ec51ab36-a859-4598-97e3-9904217985a9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:37.761747 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ec51ab36-a859-4598-97e3-9904217985a9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:37.762239 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ec51ab36-a859-4598-97e3-9904217985a9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:37.762685 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ec51ab36-a859-4598-97e3-9904217985a9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:37.763388 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ec51ab36-a859-4598-97e3-9904217985a9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:37.763855 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ec51ab36-a859-4598-97e3-9904217985a9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:37.764308 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ec51ab36-a859-4598-97e3-9904217985a9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:37.928452 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ec51ab36-a859-4598-97e3-9904217985a9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:37.937826 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ec51ab36-a859-4598-97e3-9904217985a9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217" status: 200 len: 1319 microversion: 2.1 time: 0.187195 Aug 17 23:52:37.952075 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 594/1170] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:37 2022] GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:38.681786 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a7d6f050-3044-4289-be1f-c4ca7bf89bce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:38.682377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a7d6f050-3044-4289-be1f-c4ca7bf89bce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:38.689773 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a7d6f050-3044-4289-be1f-c4ca7bf89bce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:38.690255 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a7d6f050-3044-4289-be1f-c4ca7bf89bce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:38.690913 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a7d6f050-3044-4289-be1f-c4ca7bf89bce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:38.691830 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a7d6f050-3044-4289-be1f-c4ca7bf89bce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:38.692537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a7d6f050-3044-4289-be1f-c4ca7bf89bce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:38.693176 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a7d6f050-3044-4289-be1f-c4ca7bf89bce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:38.834404 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a7d6f050-3044-4289-be1f-c4ca7bf89bce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:38.842528 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a7d6f050-3044-4289-be1f-c4ca7bf89bce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:38.844057 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a7d6f050-3044-4289-be1f-c4ca7bf89bce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:38.845221 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a7d6f050-3044-4289-be1f-c4ca7bf89bce tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1738 microversion: 2.20 time: 0.168414 Aug 17 23:52:38.846077 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 577/1171] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:38 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:38.958559 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1d6431e1-45de-489e-9121-4c2bd50eb994 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:38.959176 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1d6431e1-45de-489e-9121-4c2bd50eb994 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:38.965642 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1d6431e1-45de-489e-9121-4c2bd50eb994 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:38.966185 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1d6431e1-45de-489e-9121-4c2bd50eb994 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:38.966622 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1d6431e1-45de-489e-9121-4c2bd50eb994 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:38.967310 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1d6431e1-45de-489e-9121-4c2bd50eb994 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:38.967763 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1d6431e1-45de-489e-9121-4c2bd50eb994 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:38.968232 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1d6431e1-45de-489e-9121-4c2bd50eb994 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:38.990354 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=100 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:52:39.104938 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1d6431e1-45de-489e-9121-4c2bd50eb994 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:39.112987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1d6431e1-45de-489e-9121-4c2bd50eb994 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217" status: 200 len: 1319 microversion: 2.1 time: 0.158300 Aug 17 23:52:39.113908 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 595/1172] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:38 2022] GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:39.286824 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-13065d6a-b613-4ad6-8038-7f02f6c7c6df req-6748da37-0f18-4ce8-b5cd-83c39820bdfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1edaabd4-258c-42f9-bafb-0c574cd21217", "name": "network-vif-plugged", "status": "completed", "tag": "230d3f9d-0355-42fd-bd7e-6ee6dca9d675"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:52:39.296824 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-13065d6a-b613-4ad6-8038-7f02f6c7c6df req-6748da37-0f18-4ce8-b5cd-83c39820bdfa service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:39.297457 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-13065d6a-b613-4ad6-8038-7f02f6c7c6df req-6748da37-0f18-4ce8-b5cd-83c39820bdfa service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:39.298582 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-13065d6a-b613-4ad6-8038-7f02f6c7c6df req-6748da37-0f18-4ce8-b5cd-83c39820bdfa service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:39.310666 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-13065d6a-b613-4ad6-8038-7f02f6c7c6df req-6748da37-0f18-4ce8-b5cd-83c39820bdfa service nova] Creating event network-vif-plugged:230d3f9d-0355-42fd-bd7e-6ee6dca9d675 for instance 1edaabd4-258c-42f9-bafb-0c574cd21217 on hv-cinder-82002 Aug 17 23:52:39.316121 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-13065d6a-b613-4ad6-8038-7f02f6c7c6df req-6748da37-0f18-4ce8-b5cd-83c39820bdfa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033581 Aug 17 23:52:39.317111 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 578/1173] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:52:39.868464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ec3b3a41-7635-44b4-b01a-76f83c37d96d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:39.869166 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ec3b3a41-7635-44b4-b01a-76f83c37d96d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:39.871183 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=2 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:52:39.879746 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ec3b3a41-7635-44b4-b01a-76f83c37d96d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:39.880610 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ec3b3a41-7635-44b4-b01a-76f83c37d96d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:39.881292 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ec3b3a41-7635-44b4-b01a-76f83c37d96d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:39.882237 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ec3b3a41-7635-44b4-b01a-76f83c37d96d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:39.882922 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ec3b3a41-7635-44b4-b01a-76f83c37d96d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:39.883417 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ec3b3a41-7635-44b4-b01a-76f83c37d96d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:40.030815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ec3b3a41-7635-44b4-b01a-76f83c37d96d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:40.039679 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ec3b3a41-7635-44b4-b01a-76f83c37d96d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:40.041278 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ec3b3a41-7635-44b4-b01a-76f83c37d96d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:40.042481 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ec3b3a41-7635-44b4-b01a-76f83c37d96d tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1738 microversion: 2.20 time: 0.178151 Aug 17 23:52:40.043036 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 596/1174] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:39 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:40.135730 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-6fb5c0ca-fb0e-4cbf-b6a0-f0abc725e895 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:40.136728 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-6fb5c0ca-fb0e-4cbf-b6a0-f0abc725e895 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:40.141725 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:52:40.142487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=6 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:52:40.148234 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6fb5c0ca-fb0e-4cbf-b6a0-f0abc725e895 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:40.148728 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6fb5c0ca-fb0e-4cbf-b6a0-f0abc725e895 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:40.149171 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6fb5c0ca-fb0e-4cbf-b6a0-f0abc725e895 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:40.149877 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6fb5c0ca-fb0e-4cbf-b6a0-f0abc725e895 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:40.150334 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6fb5c0ca-fb0e-4cbf-b6a0-f0abc725e895 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:40.150763 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6fb5c0ca-fb0e-4cbf-b6a0-f0abc725e895 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:40.295124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-6fb5c0ca-fb0e-4cbf-b6a0-f0abc725e895 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:40.302743 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-6fb5c0ca-fb0e-4cbf-b6a0-f0abc725e895 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217" status: 200 len: 1319 microversion: 2.1 time: 0.171765 Aug 17 23:52:40.303527 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 579/1175] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:40 2022] GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:41.065487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-cdca27f1-4f5e-4c4c-8ba4-9629224296bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:41.066085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-cdca27f1-4f5e-4c4c-8ba4-9629224296bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:41.072840 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cdca27f1-4f5e-4c4c-8ba4-9629224296bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:41.073844 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cdca27f1-4f5e-4c4c-8ba4-9629224296bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:41.074287 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cdca27f1-4f5e-4c4c-8ba4-9629224296bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:41.074991 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cdca27f1-4f5e-4c4c-8ba4-9629224296bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:41.076131 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cdca27f1-4f5e-4c4c-8ba4-9629224296bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:41.076557 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cdca27f1-4f5e-4c4c-8ba4-9629224296bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:41.222186 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-cdca27f1-4f5e-4c4c-8ba4-9629224296bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:41.231104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-cdca27f1-4f5e-4c4c-8ba4-9629224296bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:41.233016 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-cdca27f1-4f5e-4c4c-8ba4-9629224296bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:41.234264 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-cdca27f1-4f5e-4c4c-8ba4-9629224296bc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1738 microversion: 2.20 time: 0.172718 Aug 17 23:52:41.234895 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 597/1176] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:41 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:52:41.323435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b6e7e9a3-ee96-417a-98dc-b16a7c0e1832 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:41.324681 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b6e7e9a3-ee96-417a-98dc-b16a7c0e1832 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:41.332288 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b6e7e9a3-ee96-417a-98dc-b16a7c0e1832 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:41.333125 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b6e7e9a3-ee96-417a-98dc-b16a7c0e1832 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:41.333564 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b6e7e9a3-ee96-417a-98dc-b16a7c0e1832 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:41.334648 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b6e7e9a3-ee96-417a-98dc-b16a7c0e1832 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:41.335329 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b6e7e9a3-ee96-417a-98dc-b16a7c0e1832 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:41.336018 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b6e7e9a3-ee96-417a-98dc-b16a7c0e1832 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:41.497311 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b6e7e9a3-ee96-417a-98dc-b16a7c0e1832 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:41.506872 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b6e7e9a3-ee96-417a-98dc-b16a7c0e1832 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217" status: 200 len: 1508 microversion: 2.1 time: 0.187286 Aug 17 23:52:41.507173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 580/1177] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:52:41 2022] GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217 => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:52:42.258831 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1b97978f-227f-4ea9-9cfa-dcdc40d85c74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:42.259443 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1b97978f-227f-4ea9-9cfa-dcdc40d85c74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:42.270612 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1b97978f-227f-4ea9-9cfa-dcdc40d85c74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:42.271108 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1b97978f-227f-4ea9-9cfa-dcdc40d85c74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:42.271548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1b97978f-227f-4ea9-9cfa-dcdc40d85c74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:42.272694 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1b97978f-227f-4ea9-9cfa-dcdc40d85c74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:42.273159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1b97978f-227f-4ea9-9cfa-dcdc40d85c74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:42.273586 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1b97978f-227f-4ea9-9cfa-dcdc40d85c74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:42.422123 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1b97978f-227f-4ea9-9cfa-dcdc40d85c74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:42.430482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1b97978f-227f-4ea9-9cfa-dcdc40d85c74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:42.432006 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1b97978f-227f-4ea9-9cfa-dcdc40d85c74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:42.433539 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1b97978f-227f-4ea9-9cfa-dcdc40d85c74 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1738 microversion: 2.20 time: 0.178609 Aug 17 23:52:42.434402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 598/1178] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:42 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:43.458616 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-56f8e12a-2f20-4851-9f34-1894d3cf9b21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:43.459222 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-56f8e12a-2f20-4851-9f34-1894d3cf9b21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:43.466316 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-56f8e12a-2f20-4851-9f34-1894d3cf9b21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:43.466798 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-56f8e12a-2f20-4851-9f34-1894d3cf9b21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:43.467773 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-56f8e12a-2f20-4851-9f34-1894d3cf9b21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:43.468492 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-56f8e12a-2f20-4851-9f34-1894d3cf9b21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:43.468943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-56f8e12a-2f20-4851-9f34-1894d3cf9b21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:43.469363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-56f8e12a-2f20-4851-9f34-1894d3cf9b21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:43.473193 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=100 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:52:43.688660 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-56f8e12a-2f20-4851-9f34-1894d3cf9b21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:43.696789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-56f8e12a-2f20-4851-9f34-1894d3cf9b21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:43.698338 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-56f8e12a-2f20-4851-9f34-1894d3cf9b21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:43.699537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-56f8e12a-2f20-4851-9f34-1894d3cf9b21 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1720 microversion: 2.20 time: 0.244915 Aug 17 23:52:43.700347 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 581/1179] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:43 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1720 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:44.722829 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-063241d1-c732-490f-853d-aa2443530e52 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:44.723435 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-063241d1-c732-490f-853d-aa2443530e52 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:44.730214 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-063241d1-c732-490f-853d-aa2443530e52 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:44.730685 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-063241d1-c732-490f-853d-aa2443530e52 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:44.731115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-063241d1-c732-490f-853d-aa2443530e52 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:44.731791 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-063241d1-c732-490f-853d-aa2443530e52 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:44.732274 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-063241d1-c732-490f-853d-aa2443530e52 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:44.733342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-063241d1-c732-490f-853d-aa2443530e52 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:44.865678 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-063241d1-c732-490f-853d-aa2443530e52 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:44.874122 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-063241d1-c732-490f-853d-aa2443530e52 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:44.875609 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-063241d1-c732-490f-853d-aa2443530e52 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:44.876829 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-063241d1-c732-490f-853d-aa2443530e52 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1720 microversion: 2.20 time: 0.157933 Aug 17 23:52:44.877375 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 599/1180] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:44 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:45.900468 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c559826a-6c22-47e0-aa2a-5f36776daa5f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:45.901145 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c559826a-6c22-47e0-aa2a-5f36776daa5f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:45.907537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c559826a-6c22-47e0-aa2a-5f36776daa5f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:45.908079 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c559826a-6c22-47e0-aa2a-5f36776daa5f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:45.908522 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c559826a-6c22-47e0-aa2a-5f36776daa5f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:45.909216 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c559826a-6c22-47e0-aa2a-5f36776daa5f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:45.909675 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c559826a-6c22-47e0-aa2a-5f36776daa5f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:45.910101 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c559826a-6c22-47e0-aa2a-5f36776daa5f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:46.043631 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c559826a-6c22-47e0-aa2a-5f36776daa5f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:46.052339 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c559826a-6c22-47e0-aa2a-5f36776daa5f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:46.053876 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c559826a-6c22-47e0-aa2a-5f36776daa5f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:46.055118 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c559826a-6c22-47e0-aa2a-5f36776daa5f tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1720 microversion: 2.20 time: 0.158645 Aug 17 23:52:46.056092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 582/1181] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:45 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:47.078224 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-edf39a95-c677-498e-94de-486462497d48 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:47.078926 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-edf39a95-c677-498e-94de-486462497d48 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:47.086135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-edf39a95-c677-498e-94de-486462497d48 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:47.086706 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-edf39a95-c677-498e-94de-486462497d48 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:47.087142 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-edf39a95-c677-498e-94de-486462497d48 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:47.088401 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-edf39a95-c677-498e-94de-486462497d48 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:47.089260 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-edf39a95-c677-498e-94de-486462497d48 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:47.089753 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-edf39a95-c677-498e-94de-486462497d48 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:47.230009 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-edf39a95-c677-498e-94de-486462497d48 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:47.241648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-edf39a95-c677-498e-94de-486462497d48 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:47.243186 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-edf39a95-c677-498e-94de-486462497d48 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:47.244706 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-edf39a95-c677-498e-94de-486462497d48 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1663 microversion: 2.20 time: 0.170753 Aug 17 23:52:47.245563 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 600/1182] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:47 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1663 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:47.268903 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-27babf17-535f-4592-bc57-e81736d6e881 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "feeec445-ba9a-4d3c-b1ff-37326fefebc5"}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:52:47.271638 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-27babf17-535f-4592-bc57-e81736d6e881 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:47.273554 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-0d55841e-8645-4a4e-bd06-f61ce0cdf4d6 req-e9f785ad-713c-431f-acf8-e44937066b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011c37dd-ede6-411d-b147-395b6e36ec9d", "name": "network-vif-unplugged", "status": "completed", "tag": "1cf07451-1bbc-4e01-a03f-428d2ab9b4b7"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:52:47.279799 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-27babf17-535f-4592-bc57-e81736d6e881 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:47.280723 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-27babf17-535f-4592-bc57-e81736d6e881 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:47.281347 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-27babf17-535f-4592-bc57-e81736d6e881 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:47.282825 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-27babf17-535f-4592-bc57-e81736d6e881 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:47.283450 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-27babf17-535f-4592-bc57-e81736d6e881 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:47.284056 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-27babf17-535f-4592-bc57-e81736d6e881 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:47.288166 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-0d55841e-8645-4a4e-bd06-f61ce0cdf4d6 req-e9f785ad-713c-431f-acf8-e44937066b30 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:47.288658 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-0d55841e-8645-4a4e-bd06-f61ce0cdf4d6 req-e9f785ad-713c-431f-acf8-e44937066b30 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:47.289246 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-0d55841e-8645-4a4e-bd06-f61ce0cdf4d6 req-e9f785ad-713c-431f-acf8-e44937066b30 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:47.301411 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.compute.server_external_events [req-0d55841e-8645-4a4e-bd06-f61ce0cdf4d6 req-e9f785ad-713c-431f-acf8-e44937066b30 service nova] Unable to find a host for instance 011c37dd-ede6-411d-b147-395b6e36ec9d. Dropping event network-vif-unplugged {{(pid=131394) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 17 23:52:47.302642 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-0d55841e-8645-4a4e-bd06-f61ce0cdf4d6 req-e9f785ad-713c-431f-acf8-e44937066b30 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033728 Aug 17 23:52:47.303184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 601/1183] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 17 23:52:47.576892 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-27babf17-535f-4592-bc57-e81736d6e881 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "POST /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.313115 Aug 17 23:52:47.577525 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 583/1184] 10.222.0.26 () {62 vars in 1364 bytes} [Wed Aug 17 23:52:47 2022] POST /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d/os-volume_attachments => generated 188 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 23:52:47.708432 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a69b1497-fc50-4669-891d-27b5feaf5e76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:47.708924 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a69b1497-fc50-4669-891d-27b5feaf5e76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:47.715313 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a69b1497-fc50-4669-891d-27b5feaf5e76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:47.715738 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a69b1497-fc50-4669-891d-27b5feaf5e76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:47.716201 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a69b1497-fc50-4669-891d-27b5feaf5e76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:47.716885 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a69b1497-fc50-4669-891d-27b5feaf5e76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:47.717332 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a69b1497-fc50-4669-891d-27b5feaf5e76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:47.717750 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a69b1497-fc50-4669-891d-27b5feaf5e76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:47.975824 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a69b1497-fc50-4669-891d-27b5feaf5e76 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "DELETE /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d/os-volume_attachments/feeec445-ba9a-4d3c-b1ff-37326fefebc5" status: 202 len: 0 microversion: 2.20 time: 0.272152 Aug 17 23:52:47.976448 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 602/1185] 10.222.0.26 () {60 vars in 1457 bytes} [Wed Aug 17 23:52:47 2022] DELETE /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d/os-volume_attachments/feeec445-ba9a-4d3c-b1ff-37326fefebc5 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 23:52:48.040347 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-60ae6c5c-bb43-46bb-83c1-6ee5f23f43c8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:52:48.040946 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-60ae6c5c-bb43-46bb-83c1-6ee5f23f43c8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:48.048151 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-60ae6c5c-bb43-46bb-83c1-6ee5f23f43c8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:48.048637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-60ae6c5c-bb43-46bb-83c1-6ee5f23f43c8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:48.049075 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-60ae6c5c-bb43-46bb-83c1-6ee5f23f43c8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:48.049771 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-60ae6c5c-bb43-46bb-83c1-6ee5f23f43c8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:48.050227 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-60ae6c5c-bb43-46bb-83c1-6ee5f23f43c8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:48.050651 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-60ae6c5c-bb43-46bb-83c1-6ee5f23f43c8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:48.080179 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-60ae6c5c-bb43-46bb-83c1-6ee5f23f43c8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=131395) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 23:52:48.148756 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-60ae6c5c-bb43-46bb-83c1-6ee5f23f43c8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "POST /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d/action" status: 202 len: 0 microversion: 2.20 time: 0.109035 Aug 17 23:52:48.149179 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 584/1186] 10.222.0.26 () {62 vars in 1319 bytes} [Wed Aug 17 23:52:48 2022] POST /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 23:52:48.154858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9eae50f8-44ff-4593-ad6a-6d15ee110392 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:48.155565 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9eae50f8-44ff-4593-ad6a-6d15ee110392 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:48.161987 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9eae50f8-44ff-4593-ad6a-6d15ee110392 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:48.162828 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9eae50f8-44ff-4593-ad6a-6d15ee110392 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:48.163337 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9eae50f8-44ff-4593-ad6a-6d15ee110392 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:48.164064 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9eae50f8-44ff-4593-ad6a-6d15ee110392 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:48.164560 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9eae50f8-44ff-4593-ad6a-6d15ee110392 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:48.164960 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9eae50f8-44ff-4593-ad6a-6d15ee110392 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:48.309089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9eae50f8-44ff-4593-ad6a-6d15ee110392 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:48.318005 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9eae50f8-44ff-4593-ad6a-6d15ee110392 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:48.319564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9eae50f8-44ff-4593-ad6a-6d15ee110392 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:48.320795 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9eae50f8-44ff-4593-ad6a-6d15ee110392 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1671 microversion: 2.20 time: 0.170030 Aug 17 23:52:48.321353 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 603/1187] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:48 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:49.345453 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-6b2cb6ff-3054-4994-8830-6672fc5f3f84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:49.346648 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-6b2cb6ff-3054-4994-8830-6672fc5f3f84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:49.352837 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6b2cb6ff-3054-4994-8830-6672fc5f3f84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:49.353325 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6b2cb6ff-3054-4994-8830-6672fc5f3f84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:49.353758 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6b2cb6ff-3054-4994-8830-6672fc5f3f84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:49.354456 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6b2cb6ff-3054-4994-8830-6672fc5f3f84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:49.355081 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6b2cb6ff-3054-4994-8830-6672fc5f3f84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:49.355506 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6b2cb6ff-3054-4994-8830-6672fc5f3f84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:49.604808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-6b2cb6ff-3054-4994-8830-6672fc5f3f84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:49.612919 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-6b2cb6ff-3054-4994-8830-6672fc5f3f84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:49.614537 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-6b2cb6ff-3054-4994-8830-6672fc5f3f84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:49.615788 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-6b2cb6ff-3054-4994-8830-6672fc5f3f84 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.275706 Aug 17 23:52:49.616509 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 585/1188] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:49 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:50.638764 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b4d49766-7ed9-4e20-9e7c-719ae96b0291 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:50.639379 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b4d49766-7ed9-4e20-9e7c-719ae96b0291 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:50.646404 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b4d49766-7ed9-4e20-9e7c-719ae96b0291 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:50.646899 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b4d49766-7ed9-4e20-9e7c-719ae96b0291 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:50.647344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b4d49766-7ed9-4e20-9e7c-719ae96b0291 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:50.648197 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b4d49766-7ed9-4e20-9e7c-719ae96b0291 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:50.648661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b4d49766-7ed9-4e20-9e7c-719ae96b0291 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:50.649089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b4d49766-7ed9-4e20-9e7c-719ae96b0291 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:50.810562 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b4d49766-7ed9-4e20-9e7c-719ae96b0291 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:50.819294 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b4d49766-7ed9-4e20-9e7c-719ae96b0291 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:50.820842 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b4d49766-7ed9-4e20-9e7c-719ae96b0291 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:50.822012 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b4d49766-7ed9-4e20-9e7c-719ae96b0291 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.187249 Aug 17 23:52:50.822568 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 604/1189] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:50 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:51.846783 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-fdb264d4-2175-4b60-ab53-d3ac2f68fe70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:51.848235 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-fdb264d4-2175-4b60-ab53-d3ac2f68fe70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:51.856514 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fdb264d4-2175-4b60-ab53-d3ac2f68fe70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:51.857005 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fdb264d4-2175-4b60-ab53-d3ac2f68fe70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:51.857444 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fdb264d4-2175-4b60-ab53-d3ac2f68fe70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:51.858157 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fdb264d4-2175-4b60-ab53-d3ac2f68fe70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:51.858613 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fdb264d4-2175-4b60-ab53-d3ac2f68fe70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:51.859061 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-fdb264d4-2175-4b60-ab53-d3ac2f68fe70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:51.997937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-fdb264d4-2175-4b60-ab53-d3ac2f68fe70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:52.007945 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-fdb264d4-2175-4b60-ab53-d3ac2f68fe70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:52.009539 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-fdb264d4-2175-4b60-ab53-d3ac2f68fe70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:52.010667 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-fdb264d4-2175-4b60-ab53-d3ac2f68fe70 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.169132 Aug 17 23:52:52.011531 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 586/1190] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:51 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:53.034446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-dda990aa-f3c1-4b3a-ba6a-b9d54143cf2b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:53.035890 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-dda990aa-f3c1-4b3a-ba6a-b9d54143cf2b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:53.043381 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dda990aa-f3c1-4b3a-ba6a-b9d54143cf2b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:53.043983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dda990aa-f3c1-4b3a-ba6a-b9d54143cf2b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:53.044758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dda990aa-f3c1-4b3a-ba6a-b9d54143cf2b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:53.045487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dda990aa-f3c1-4b3a-ba6a-b9d54143cf2b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:53.046033 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dda990aa-f3c1-4b3a-ba6a-b9d54143cf2b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:53.046534 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dda990aa-f3c1-4b3a-ba6a-b9d54143cf2b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:53.187018 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dda990aa-f3c1-4b3a-ba6a-b9d54143cf2b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:53.197192 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dda990aa-f3c1-4b3a-ba6a-b9d54143cf2b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:53.198696 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dda990aa-f3c1-4b3a-ba6a-b9d54143cf2b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:53.199952 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-dda990aa-f3c1-4b3a-ba6a-b9d54143cf2b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.170227 Aug 17 23:52:53.200537 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 605/1191] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:53 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:54.224295 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ce1c6125-e9e6-41b5-a495-60c8ed3aeba9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:54.225754 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ce1c6125-e9e6-41b5-a495-60c8ed3aeba9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:54.235611 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ce1c6125-e9e6-41b5-a495-60c8ed3aeba9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:54.236233 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ce1c6125-e9e6-41b5-a495-60c8ed3aeba9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:54.236675 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ce1c6125-e9e6-41b5-a495-60c8ed3aeba9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:54.237400 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ce1c6125-e9e6-41b5-a495-60c8ed3aeba9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:54.237849 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ce1c6125-e9e6-41b5-a495-60c8ed3aeba9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:54.238266 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ce1c6125-e9e6-41b5-a495-60c8ed3aeba9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:54.373585 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ce1c6125-e9e6-41b5-a495-60c8ed3aeba9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:54.382034 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ce1c6125-e9e6-41b5-a495-60c8ed3aeba9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:54.383552 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ce1c6125-e9e6-41b5-a495-60c8ed3aeba9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:54.384745 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ce1c6125-e9e6-41b5-a495-60c8ed3aeba9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.165475 Aug 17 23:52:54.385305 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 587/1192] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:54 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:55.409471 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-33745de9-7b37-44e6-a46d-de6a12f2c2e2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:55.410083 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-33745de9-7b37-44e6-a46d-de6a12f2c2e2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:55.416869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-33745de9-7b37-44e6-a46d-de6a12f2c2e2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:55.417352 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-33745de9-7b37-44e6-a46d-de6a12f2c2e2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:55.417787 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-33745de9-7b37-44e6-a46d-de6a12f2c2e2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:55.418483 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-33745de9-7b37-44e6-a46d-de6a12f2c2e2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:55.418937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-33745de9-7b37-44e6-a46d-de6a12f2c2e2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:55.419361 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-33745de9-7b37-44e6-a46d-de6a12f2c2e2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:55.558417 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-33745de9-7b37-44e6-a46d-de6a12f2c2e2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:55.567868 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-33745de9-7b37-44e6-a46d-de6a12f2c2e2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:55.569412 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-33745de9-7b37-44e6-a46d-de6a12f2c2e2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:55.570597 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-33745de9-7b37-44e6-a46d-de6a12f2c2e2 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.165547 Aug 17 23:52:55.571163 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 606/1193] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:55 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:56.593275 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f2bf60f6-7fea-4b49-ac19-69cc83c23dac tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:56.594532 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f2bf60f6-7fea-4b49-ac19-69cc83c23dac tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:56.601603 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2bf60f6-7fea-4b49-ac19-69cc83c23dac tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:56.602386 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2bf60f6-7fea-4b49-ac19-69cc83c23dac tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:56.603058 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2bf60f6-7fea-4b49-ac19-69cc83c23dac tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:56.603772 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2bf60f6-7fea-4b49-ac19-69cc83c23dac tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:56.604259 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2bf60f6-7fea-4b49-ac19-69cc83c23dac tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:56.604688 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f2bf60f6-7fea-4b49-ac19-69cc83c23dac tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:56.748131 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f2bf60f6-7fea-4b49-ac19-69cc83c23dac tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:56.756719 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f2bf60f6-7fea-4b49-ac19-69cc83c23dac tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:56.758225 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f2bf60f6-7fea-4b49-ac19-69cc83c23dac tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:56.759387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f2bf60f6-7fea-4b49-ac19-69cc83c23dac tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.170016 Aug 17 23:52:56.759977 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 588/1194] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:56 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:57.782873 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ce2dc115-a9d6-4086-84b9-a39f5292fd6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:57.783544 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ce2dc115-a9d6-4086-84b9-a39f5292fd6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:57.790353 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce2dc115-a9d6-4086-84b9-a39f5292fd6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:57.790854 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce2dc115-a9d6-4086-84b9-a39f5292fd6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:57.791281 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce2dc115-a9d6-4086-84b9-a39f5292fd6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:57.791940 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce2dc115-a9d6-4086-84b9-a39f5292fd6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:57.792418 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce2dc115-a9d6-4086-84b9-a39f5292fd6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:57.792840 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ce2dc115-a9d6-4086-84b9-a39f5292fd6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:57.936371 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ce2dc115-a9d6-4086-84b9-a39f5292fd6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:57.945212 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ce2dc115-a9d6-4086-84b9-a39f5292fd6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:57.946704 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ce2dc115-a9d6-4086-84b9-a39f5292fd6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:57.947904 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ce2dc115-a9d6-4086-84b9-a39f5292fd6e tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.169069 Aug 17 23:52:57.948674 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 607/1195] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:57 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:52:58.973690 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-79dc216a-9881-4168-af7a-3e25d14b3317 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:52:58.976286 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-79dc216a-9881-4168-af7a-3e25d14b3317 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:52:58.990121 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-79dc216a-9881-4168-af7a-3e25d14b3317 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:58.991534 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-79dc216a-9881-4168-af7a-3e25d14b3317 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:58.993644 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-79dc216a-9881-4168-af7a-3e25d14b3317 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:58.994692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-79dc216a-9881-4168-af7a-3e25d14b3317 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:52:58.995636 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-79dc216a-9881-4168-af7a-3e25d14b3317 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:52:58.998297 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-79dc216a-9881-4168-af7a-3e25d14b3317 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:52:59.158094 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-79dc216a-9881-4168-af7a-3e25d14b3317 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:59.166307 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-79dc216a-9881-4168-af7a-3e25d14b3317 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:59.167813 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-79dc216a-9881-4168-af7a-3e25d14b3317 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:52:59.169008 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-79dc216a-9881-4168-af7a-3e25d14b3317 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.201693 Aug 17 23:52:59.169578 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 589/1196] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:52:58 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:53:00.192760 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-aa6f4b9c-f8d4-4e8a-8ea1-777f12c19515 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:00.193366 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-aa6f4b9c-f8d4-4e8a-8ea1-777f12c19515 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:00.199785 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aa6f4b9c-f8d4-4e8a-8ea1-777f12c19515 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:00.200294 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aa6f4b9c-f8d4-4e8a-8ea1-777f12c19515 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:00.200726 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aa6f4b9c-f8d4-4e8a-8ea1-777f12c19515 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:00.201400 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aa6f4b9c-f8d4-4e8a-8ea1-777f12c19515 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:00.201849 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aa6f4b9c-f8d4-4e8a-8ea1-777f12c19515 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:00.202269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-aa6f4b9c-f8d4-4e8a-8ea1-777f12c19515 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:00.331666 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-aa6f4b9c-f8d4-4e8a-8ea1-777f12c19515 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:00.339627 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-aa6f4b9c-f8d4-4e8a-8ea1-777f12c19515 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:00.341145 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-aa6f4b9c-f8d4-4e8a-8ea1-777f12c19515 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:00.342299 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-aa6f4b9c-f8d4-4e8a-8ea1-777f12c19515 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.153384 Aug 17 23:53:00.342847 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 608/1197] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:53:00 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:53:01.365322 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2a85e67e-52a6-44d2-aebf-b81f4da80d78 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:01.365945 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-2a85e67e-52a6-44d2-aebf-b81f4da80d78 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:01.372458 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2a85e67e-52a6-44d2-aebf-b81f4da80d78 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:01.372949 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2a85e67e-52a6-44d2-aebf-b81f4da80d78 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:01.373391 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2a85e67e-52a6-44d2-aebf-b81f4da80d78 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:01.374090 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2a85e67e-52a6-44d2-aebf-b81f4da80d78 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:01.374551 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2a85e67e-52a6-44d2-aebf-b81f4da80d78 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:01.374980 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-2a85e67e-52a6-44d2-aebf-b81f4da80d78 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:01.506073 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2a85e67e-52a6-44d2-aebf-b81f4da80d78 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:01.514021 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2a85e67e-52a6-44d2-aebf-b81f4da80d78 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:01.515533 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-2a85e67e-52a6-44d2-aebf-b81f4da80d78 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:01.517253 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2a85e67e-52a6-44d2-aebf-b81f4da80d78 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.155858 Aug 17 23:53:01.517814 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 590/1198] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:53:01 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:53:02.539757 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b554ca6d-bf40-4fb5-9884-c3bba8a26875 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:02.540394 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b554ca6d-bf40-4fb5-9884-c3bba8a26875 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:02.546940 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b554ca6d-bf40-4fb5-9884-c3bba8a26875 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:02.547902 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b554ca6d-bf40-4fb5-9884-c3bba8a26875 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:02.548370 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b554ca6d-bf40-4fb5-9884-c3bba8a26875 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:02.549089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b554ca6d-bf40-4fb5-9884-c3bba8a26875 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:02.549547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b554ca6d-bf40-4fb5-9884-c3bba8a26875 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:02.549972 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b554ca6d-bf40-4fb5-9884-c3bba8a26875 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:02.678670 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b554ca6d-bf40-4fb5-9884-c3bba8a26875 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:02.686540 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b554ca6d-bf40-4fb5-9884-c3bba8a26875 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:02.688565 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b554ca6d-bf40-4fb5-9884-c3bba8a26875 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:02.689717 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b554ca6d-bf40-4fb5-9884-c3bba8a26875 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.154167 Aug 17 23:53:02.690279 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 609/1199] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:53:02 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:53:03.712357 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9afc2976-f70b-438f-b9e6-ae534cf2be80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:03.712905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9afc2976-f70b-438f-b9e6-ae534cf2be80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:03.719911 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9afc2976-f70b-438f-b9e6-ae534cf2be80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:03.720672 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9afc2976-f70b-438f-b9e6-ae534cf2be80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:03.721115 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9afc2976-f70b-438f-b9e6-ae534cf2be80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:03.721835 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9afc2976-f70b-438f-b9e6-ae534cf2be80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:03.722290 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9afc2976-f70b-438f-b9e6-ae534cf2be80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:03.722714 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9afc2976-f70b-438f-b9e6-ae534cf2be80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:03.848185 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9afc2976-f70b-438f-b9e6-ae534cf2be80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:03.857353 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9afc2976-f70b-438f-b9e6-ae534cf2be80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:03.859229 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9afc2976-f70b-438f-b9e6-ae534cf2be80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:03.860941 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9afc2976-f70b-438f-b9e6-ae534cf2be80 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.152667 Aug 17 23:53:03.861507 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 591/1200] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:53:03 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:53:04.883879 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-df983aae-8c06-46c2-9b89-2c5f85279cf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:04.884516 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-df983aae-8c06-46c2-9b89-2c5f85279cf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:04.886796 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=38 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:53:04.892142 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df983aae-8c06-46c2-9b89-2c5f85279cf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:04.892629 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df983aae-8c06-46c2-9b89-2c5f85279cf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:04.893062 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df983aae-8c06-46c2-9b89-2c5f85279cf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:04.893751 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df983aae-8c06-46c2-9b89-2c5f85279cf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:04.894203 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df983aae-8c06-46c2-9b89-2c5f85279cf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:04.894625 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df983aae-8c06-46c2-9b89-2c5f85279cf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:04.909979 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:53:05.029067 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-df983aae-8c06-46c2-9b89-2c5f85279cf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:05.037806 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-df983aae-8c06-46c2-9b89-2c5f85279cf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:05.039316 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-df983aae-8c06-46c2-9b89-2c5f85279cf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:05.040523 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-df983aae-8c06-46c2-9b89-2c5f85279cf8 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.160579 Aug 17 23:53:05.041090 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 610/1201] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:53:04 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:53:06.064127 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ba000384-7712-4f13-966e-3f4319588904 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:06.064749 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ba000384-7712-4f13-966e-3f4319588904 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:06.067045 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:53:06.072362 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ba000384-7712-4f13-966e-3f4319588904 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:06.072845 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ba000384-7712-4f13-966e-3f4319588904 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:06.073281 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ba000384-7712-4f13-966e-3f4319588904 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:06.073965 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ba000384-7712-4f13-966e-3f4319588904 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:06.074445 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ba000384-7712-4f13-966e-3f4319588904 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:06.074866 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ba000384-7712-4f13-966e-3f4319588904 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:06.204362 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ba000384-7712-4f13-966e-3f4319588904 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:06.212454 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ba000384-7712-4f13-966e-3f4319588904 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:06.213945 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ba000384-7712-4f13-966e-3f4319588904 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:06.215104 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ba000384-7712-4f13-966e-3f4319588904 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.154990 Aug 17 23:53:06.215653 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 592/1202] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:53:06 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:53:07.239075 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d5116c7c-0447-49e4-84df-33deb0c8f403 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:07.239717 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d5116c7c-0447-49e4-84df-33deb0c8f403 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:07.246221 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5116c7c-0447-49e4-84df-33deb0c8f403 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:07.246698 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5116c7c-0447-49e4-84df-33deb0c8f403 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:07.247131 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5116c7c-0447-49e4-84df-33deb0c8f403 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:07.247820 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5116c7c-0447-49e4-84df-33deb0c8f403 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:07.248308 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5116c7c-0447-49e4-84df-33deb0c8f403 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:07.248727 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d5116c7c-0447-49e4-84df-33deb0c8f403 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:07.375824 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d5116c7c-0447-49e4-84df-33deb0c8f403 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:07.383556 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d5116c7c-0447-49e4-84df-33deb0c8f403 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:07.385067 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d5116c7c-0447-49e4-84df-33deb0c8f403 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:07.386211 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d5116c7c-0447-49e4-84df-33deb0c8f403 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.151776 Aug 17 23:53:07.386768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 611/1203] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:53:07 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:53:08.409772 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-eefc8e95-f1cf-489e-a29b-1da915d1de92 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:08.410387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-eefc8e95-f1cf-489e-a29b-1da915d1de92 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:08.416994 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eefc8e95-f1cf-489e-a29b-1da915d1de92 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:08.417477 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eefc8e95-f1cf-489e-a29b-1da915d1de92 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:08.417916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eefc8e95-f1cf-489e-a29b-1da915d1de92 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:08.418603 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eefc8e95-f1cf-489e-a29b-1da915d1de92 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:08.419058 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eefc8e95-f1cf-489e-a29b-1da915d1de92 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:08.419485 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eefc8e95-f1cf-489e-a29b-1da915d1de92 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:08.551021 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-eefc8e95-f1cf-489e-a29b-1da915d1de92 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:08.558824 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-eefc8e95-f1cf-489e-a29b-1da915d1de92 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:08.560345 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-eefc8e95-f1cf-489e-a29b-1da915d1de92 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:08.561523 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-eefc8e95-f1cf-489e-a29b-1da915d1de92 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.156232 Aug 17 23:53:08.562083 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 593/1204] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:53:08 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:53:09.585045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9b25e143-0d2e-44b1-ad4a-8c3d5f1a7347 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:09.585657 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9b25e143-0d2e-44b1-ad4a-8c3d5f1a7347 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:09.592130 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9b25e143-0d2e-44b1-ad4a-8c3d5f1a7347 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:09.592609 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9b25e143-0d2e-44b1-ad4a-8c3d5f1a7347 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:09.593045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9b25e143-0d2e-44b1-ad4a-8c3d5f1a7347 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:09.593728 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9b25e143-0d2e-44b1-ad4a-8c3d5f1a7347 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:09.594689 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9b25e143-0d2e-44b1-ad4a-8c3d5f1a7347 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:09.595111 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9b25e143-0d2e-44b1-ad4a-8c3d5f1a7347 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:09.725442 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9b25e143-0d2e-44b1-ad4a-8c3d5f1a7347 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:09.733336 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9b25e143-0d2e-44b1-ad4a-8c3d5f1a7347 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:09.734870 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9b25e143-0d2e-44b1-ad4a-8c3d5f1a7347 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:09.736036 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9b25e143-0d2e-44b1-ad4a-8c3d5f1a7347 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.154873 Aug 17 23:53:09.736590 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 612/1205] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:53:09 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:53:10.468817 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-eaf5633a-cfa5-4b7d-89a2-1fe56e0c1ac0 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6abeb35a-c240-489b-b451-cdad864a126d", "device": "/dev/sdb"}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:53:10.472425 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-eaf5633a-cfa5-4b7d-89a2-1fe56e0c1ac0 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:10.478806 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eaf5633a-cfa5-4b7d-89a2-1fe56e0c1ac0 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:10.479284 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eaf5633a-cfa5-4b7d-89a2-1fe56e0c1ac0 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:10.479725 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eaf5633a-cfa5-4b7d-89a2-1fe56e0c1ac0 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:10.480446 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eaf5633a-cfa5-4b7d-89a2-1fe56e0c1ac0 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:10.480903 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eaf5633a-cfa5-4b7d-89a2-1fe56e0c1ac0 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:10.481330 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eaf5633a-cfa5-4b7d-89a2-1fe56e0c1ac0 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:10.484875 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:53:10.758550 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-fd5296a8-efc6-47ed-946b-9ecbb0088880 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:10.759169 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-fd5296a8-efc6-47ed-946b-9ecbb0088880 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:10.765611 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fd5296a8-efc6-47ed-946b-9ecbb0088880 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:10.766610 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fd5296a8-efc6-47ed-946b-9ecbb0088880 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:10.767052 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fd5296a8-efc6-47ed-946b-9ecbb0088880 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:10.767744 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fd5296a8-efc6-47ed-946b-9ecbb0088880 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:10.768230 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fd5296a8-efc6-47ed-946b-9ecbb0088880 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:10.768679 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fd5296a8-efc6-47ed-946b-9ecbb0088880 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:10.897817 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-fd5296a8-efc6-47ed-946b-9ecbb0088880 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:10.906279 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-fd5296a8-efc6-47ed-946b-9ecbb0088880 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:10.907786 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-fd5296a8-efc6-47ed-946b-9ecbb0088880 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:10.908979 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-fd5296a8-efc6-47ed-946b-9ecbb0088880 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.154401 Aug 17 23:53:10.909551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 613/1206] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:53:10 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 23:53:11.539564 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-eaf5633a-cfa5-4b7d-89a2-1fe56e0c1ac0 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "POST /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.074581 Aug 17 23:53:11.540209 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 594/1207] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 17 23:53:10 2022] POST /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217/os-volume_attachments => generated 194 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:53:11.931924 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-dee753cd-2097-4bab-a533-4ae10d6ba561 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:11.932589 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-dee753cd-2097-4bab-a533-4ae10d6ba561 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:11.939469 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dee753cd-2097-4bab-a533-4ae10d6ba561 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:11.939954 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dee753cd-2097-4bab-a533-4ae10d6ba561 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:11.940419 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dee753cd-2097-4bab-a533-4ae10d6ba561 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:11.941109 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dee753cd-2097-4bab-a533-4ae10d6ba561 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:11.941564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dee753cd-2097-4bab-a533-4ae10d6ba561 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:11.941990 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dee753cd-2097-4bab-a533-4ae10d6ba561 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:12.074787 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dee753cd-2097-4bab-a533-4ae10d6ba561 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:12.083524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dee753cd-2097-4bab-a533-4ae10d6ba561 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:12.085079 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dee753cd-2097-4bab-a533-4ae10d6ba561 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:12.086273 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-dee753cd-2097-4bab-a533-4ae10d6ba561 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.158290 Aug 17 23:53:12.086856 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 614/1208] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:53:11 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:53:13.110520 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-de25f019-1db0-4a1e-a855-6966d71be957 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:13.111260 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-de25f019-1db0-4a1e-a855-6966d71be957 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:13.117479 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-de25f019-1db0-4a1e-a855-6966d71be957 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:13.117961 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-de25f019-1db0-4a1e-a855-6966d71be957 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:13.118400 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-de25f019-1db0-4a1e-a855-6966d71be957 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:13.119089 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-de25f019-1db0-4a1e-a855-6966d71be957 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:13.119556 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-de25f019-1db0-4a1e-a855-6966d71be957 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:13.119986 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-de25f019-1db0-4a1e-a855-6966d71be957 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:13.381114 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-de25f019-1db0-4a1e-a855-6966d71be957 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:13.389036 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-de25f019-1db0-4a1e-a855-6966d71be957 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:13.390544 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-de25f019-1db0-4a1e-a855-6966d71be957 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:13.392284 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-de25f019-1db0-4a1e-a855-6966d71be957 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.286525 Aug 17 23:53:13.392846 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 595/1209] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:53:13 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:53:13.428043 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-502ab2cd-6ec8-41e4-8e18-8a90772bf44e req-db8ea992-d5aa-4cd1-953a-1626b9b73782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011c37dd-ede6-411d-b147-395b6e36ec9d", "name": "network-vif-plugged", "status": "completed", "tag": "1cf07451-1bbc-4e01-a03f-428d2ab9b4b7"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:53:13.439283 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-502ab2cd-6ec8-41e4-8e18-8a90772bf44e req-db8ea992-d5aa-4cd1-953a-1626b9b73782 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:13.439762 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-502ab2cd-6ec8-41e4-8e18-8a90772bf44e req-db8ea992-d5aa-4cd1-953a-1626b9b73782 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:13.440277 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-502ab2cd-6ec8-41e4-8e18-8a90772bf44e req-db8ea992-d5aa-4cd1-953a-1626b9b73782 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:13.451655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-502ab2cd-6ec8-41e4-8e18-8a90772bf44e req-db8ea992-d5aa-4cd1-953a-1626b9b73782 service nova] Creating event network-vif-plugged:1cf07451-1bbc-4e01-a03f-428d2ab9b4b7 for instance 011c37dd-ede6-411d-b147-395b6e36ec9d on hv-cinder-82002 Aug 17 23:53:13.456851 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-502ab2cd-6ec8-41e4-8e18-8a90772bf44e req-db8ea992-d5aa-4cd1-953a-1626b9b73782 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032495 Aug 17 23:53:13.457440 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 615/1210] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:53:14.415777 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3e8acc58-112b-4804-b943-262838ccc695 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:14.416440 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3e8acc58-112b-4804-b943-262838ccc695 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:14.423349 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3e8acc58-112b-4804-b943-262838ccc695 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:14.423826 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3e8acc58-112b-4804-b943-262838ccc695 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:14.424296 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3e8acc58-112b-4804-b943-262838ccc695 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:14.424984 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3e8acc58-112b-4804-b943-262838ccc695 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:14.425440 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3e8acc58-112b-4804-b943-262838ccc695 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:14.425863 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3e8acc58-112b-4804-b943-262838ccc695 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:14.615444 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3e8acc58-112b-4804-b943-262838ccc695 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:14.623331 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3e8acc58-112b-4804-b943-262838ccc695 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:14.624886 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3e8acc58-112b-4804-b943-262838ccc695 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:14.626068 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3e8acc58-112b-4804-b943-262838ccc695 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.214456 Aug 17 23:53:14.626623 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 596/1211] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:53:14 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:53:15.138164 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c20a8b1f-fcb7-4d5a-be38-83453760a22b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:15.138845 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c20a8b1f-fcb7-4d5a-be38-83453760a22b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:15.139153 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-e3dbbd77-0e66-4d63-86f9-4ca08086be23 req-6a4fda5d-0e02-454c-bf3a-5f55693f4f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93126672-4679-41e5-bfbd-f06836afac17", "tag": "da8d102a-c017-4932-bfb8-b3ef13097d11"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:53:15.149562 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-e3dbbd77-0e66-4d63-86f9-4ca08086be23 req-6a4fda5d-0e02-454c-bf3a-5f55693f4f22 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:15.150041 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-e3dbbd77-0e66-4d63-86f9-4ca08086be23 req-6a4fda5d-0e02-454c-bf3a-5f55693f4f22 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:15.150473 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-e3dbbd77-0e66-4d63-86f9-4ca08086be23 req-6a4fda5d-0e02-454c-bf3a-5f55693f4f22 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:15.152177 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c20a8b1f-fcb7-4d5a-be38-83453760a22b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:15.152953 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c20a8b1f-fcb7-4d5a-be38-83453760a22b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:15.155561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c20a8b1f-fcb7-4d5a-be38-83453760a22b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:15.157451 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c20a8b1f-fcb7-4d5a-be38-83453760a22b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:15.159172 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c20a8b1f-fcb7-4d5a-be38-83453760a22b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:15.161623 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c20a8b1f-fcb7-4d5a-be38-83453760a22b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:15.162971 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-e3dbbd77-0e66-4d63-86f9-4ca08086be23 req-6a4fda5d-0e02-454c-bf3a-5f55693f4f22 service nova] Creating event network-changed:da8d102a-c017-4932-bfb8-b3ef13097d11 for instance 93126672-4679-41e5-bfbd-f06836afac17 on hv-cinder-82002 Aug 17 23:53:15.168822 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-e3dbbd77-0e66-4d63-86f9-4ca08086be23 req-6a4fda5d-0e02-454c-bf3a-5f55693f4f22 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033192 Aug 17 23:53:15.169943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 597/1212] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:53:15.188696 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c20a8b1f-fcb7-4d5a-be38-83453760a22b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Going to try to terminate instance {{(pid=131394) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:53:15.262737 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c20a8b1f-fcb7-4d5a-be38-83453760a22b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 204 len: 0 microversion: 2.1 time: 0.129273 Aug 17 23:53:15.263602 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 616/1213] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:53:15 2022] DELETE /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 23:53:15.272810 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f840d7e8-b8dc-4fe6-8266-2cc8fc100509 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:15.273509 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f840d7e8-b8dc-4fe6-8266-2cc8fc100509 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:15.279589 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f840d7e8-b8dc-4fe6-8266-2cc8fc100509 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:15.280110 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f840d7e8-b8dc-4fe6-8266-2cc8fc100509 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:15.280553 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f840d7e8-b8dc-4fe6-8266-2cc8fc100509 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:15.281284 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f840d7e8-b8dc-4fe6-8266-2cc8fc100509 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:15.282275 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f840d7e8-b8dc-4fe6-8266-2cc8fc100509 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:15.282705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f840d7e8-b8dc-4fe6-8266-2cc8fc100509 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:15.418609 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-f840d7e8-b8dc-4fe6-8266-2cc8fc100509 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:15.426816 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f840d7e8-b8dc-4fe6-8266-2cc8fc100509 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.158158 Aug 17 23:53:15.427482 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 598/1214] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:15 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:15.649599 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f2af25fd-b301-467e-96a6-bf46bb4816ef tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:15.650258 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f2af25fd-b301-467e-96a6-bf46bb4816ef tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:15.656115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2af25fd-b301-467e-96a6-bf46bb4816ef tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:15.656605 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2af25fd-b301-467e-96a6-bf46bb4816ef tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:15.657046 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2af25fd-b301-467e-96a6-bf46bb4816ef tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:15.657741 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2af25fd-b301-467e-96a6-bf46bb4816ef tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:15.658210 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2af25fd-b301-467e-96a6-bf46bb4816ef tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:15.658636 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2af25fd-b301-467e-96a6-bf46bb4816ef tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:15.847302 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f2af25fd-b301-467e-96a6-bf46bb4816ef tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:15.856381 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f2af25fd-b301-467e-96a6-bf46bb4816ef tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:15.858142 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f2af25fd-b301-467e-96a6-bf46bb4816ef tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:15.859326 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f2af25fd-b301-467e-96a6-bf46bb4816ef tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.214256 Aug 17 23:53:15.860762 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 617/1215] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:53:15 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:53:16.449126 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-84b9f5e5-952e-4b4b-9fc6-76c6d36cb57e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:16.449678 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-84b9f5e5-952e-4b4b-9fc6-76c6d36cb57e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:16.456739 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-84b9f5e5-952e-4b4b-9fc6-76c6d36cb57e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:16.457225 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-84b9f5e5-952e-4b4b-9fc6-76c6d36cb57e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:16.457665 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-84b9f5e5-952e-4b4b-9fc6-76c6d36cb57e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:16.458381 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-84b9f5e5-952e-4b4b-9fc6-76c6d36cb57e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:16.458819 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-84b9f5e5-952e-4b4b-9fc6-76c6d36cb57e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:16.459245 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-84b9f5e5-952e-4b4b-9fc6-76c6d36cb57e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:16.592940 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-84b9f5e5-952e-4b4b-9fc6-76c6d36cb57e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:16.600396 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-84b9f5e5-952e-4b4b-9fc6-76c6d36cb57e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.155162 Aug 17 23:53:16.600957 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 599/1216] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:16 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:16.882196 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-0d54246a-1d67-4b37-bae7-c2df4df62f0c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:16.882819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-0d54246a-1d67-4b37-bae7-c2df4df62f0c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:16.889265 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d54246a-1d67-4b37-bae7-c2df4df62f0c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:16.889747 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d54246a-1d67-4b37-bae7-c2df4df62f0c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:16.890184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d54246a-1d67-4b37-bae7-c2df4df62f0c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:16.890875 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d54246a-1d67-4b37-bae7-c2df4df62f0c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:16.891333 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d54246a-1d67-4b37-bae7-c2df4df62f0c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:16.891761 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d54246a-1d67-4b37-bae7-c2df4df62f0c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:17.018692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0d54246a-1d67-4b37-bae7-c2df4df62f0c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:17.026506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0d54246a-1d67-4b37-bae7-c2df4df62f0c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:17.028017 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0d54246a-1d67-4b37-bae7-c2df4df62f0c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:17.029167 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-0d54246a-1d67-4b37-bae7-c2df4df62f0c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.150910 Aug 17 23:53:17.029726 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 618/1217] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:53:16 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:53:17.621985 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-01e0b5db-5290-49bb-94fe-7dd4164e1474 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:17.622625 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-01e0b5db-5290-49bb-94fe-7dd4164e1474 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:17.629610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-01e0b5db-5290-49bb-94fe-7dd4164e1474 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:17.630123 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-01e0b5db-5290-49bb-94fe-7dd4164e1474 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:17.630564 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-01e0b5db-5290-49bb-94fe-7dd4164e1474 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:17.631255 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-01e0b5db-5290-49bb-94fe-7dd4164e1474 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:17.631709 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-01e0b5db-5290-49bb-94fe-7dd4164e1474 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:17.632169 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-01e0b5db-5290-49bb-94fe-7dd4164e1474 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:17.760465 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-01e0b5db-5290-49bb-94fe-7dd4164e1474 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:17.768514 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-01e0b5db-5290-49bb-94fe-7dd4164e1474 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.150491 Aug 17 23:53:17.769083 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 600/1218] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:17 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:18.052720 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-42e27d5e-b4f1-4dd8-85d1-c04dc09d4717 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:18.053331 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-42e27d5e-b4f1-4dd8-85d1-c04dc09d4717 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:18.059688 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-42e27d5e-b4f1-4dd8-85d1-c04dc09d4717 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:18.060211 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-42e27d5e-b4f1-4dd8-85d1-c04dc09d4717 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:18.060650 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-42e27d5e-b4f1-4dd8-85d1-c04dc09d4717 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:18.061341 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-42e27d5e-b4f1-4dd8-85d1-c04dc09d4717 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:18.061794 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-42e27d5e-b4f1-4dd8-85d1-c04dc09d4717 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:18.062218 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-42e27d5e-b4f1-4dd8-85d1-c04dc09d4717 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:18.194584 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-42e27d5e-b4f1-4dd8-85d1-c04dc09d4717 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:18.202573 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-42e27d5e-b4f1-4dd8-85d1-c04dc09d4717 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:18.204094 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-42e27d5e-b4f1-4dd8-85d1-c04dc09d4717 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:18.205248 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-42e27d5e-b4f1-4dd8-85d1-c04dc09d4717 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.156458 Aug 17 23:53:18.205804 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 619/1219] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:53:18 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:53:18.789010 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-82f07262-d933-4dd8-857e-91f301aad7be tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:18.789625 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-82f07262-d933-4dd8-857e-91f301aad7be tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:18.796021 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-82f07262-d933-4dd8-857e-91f301aad7be tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:18.796506 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-82f07262-d933-4dd8-857e-91f301aad7be tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:18.797454 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-82f07262-d933-4dd8-857e-91f301aad7be tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:18.798155 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-82f07262-d933-4dd8-857e-91f301aad7be tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:18.798611 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-82f07262-d933-4dd8-857e-91f301aad7be tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:18.799037 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-82f07262-d933-4dd8-857e-91f301aad7be tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:18.932052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-82f07262-d933-4dd8-857e-91f301aad7be tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:18.940304 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-82f07262-d933-4dd8-857e-91f301aad7be tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.155510 Aug 17 23:53:18.940896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 601/1220] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:18 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:19.228446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-0f62e263-799b-4a09-ad9d-8e42a726f8d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:19.229057 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-0f62e263-799b-4a09-ad9d-8e42a726f8d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:19.235442 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0f62e263-799b-4a09-ad9d-8e42a726f8d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:19.235937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0f62e263-799b-4a09-ad9d-8e42a726f8d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:19.236400 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0f62e263-799b-4a09-ad9d-8e42a726f8d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:19.237147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0f62e263-799b-4a09-ad9d-8e42a726f8d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:19.237599 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0f62e263-799b-4a09-ad9d-8e42a726f8d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:19.238019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0f62e263-799b-4a09-ad9d-8e42a726f8d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:19.369390 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0f62e263-799b-4a09-ad9d-8e42a726f8d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:19.377374 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0f62e263-799b-4a09-ad9d-8e42a726f8d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:19.378863 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0f62e263-799b-4a09-ad9d-8e42a726f8d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:19.380034 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-0f62e263-799b-4a09-ad9d-8e42a726f8d9 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.155846 Aug 17 23:53:19.380585 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 620/1221] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:53:19 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:53:19.961044 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-82af5f3c-3b84-4e3c-92a8-01533e97c695 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:19.961850 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-82af5f3c-3b84-4e3c-92a8-01533e97c695 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:19.969712 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-82af5f3c-3b84-4e3c-92a8-01533e97c695 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:19.970206 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-82af5f3c-3b84-4e3c-92a8-01533e97c695 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:19.970644 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-82af5f3c-3b84-4e3c-92a8-01533e97c695 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:19.971347 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-82af5f3c-3b84-4e3c-92a8-01533e97c695 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:19.971787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-82af5f3c-3b84-4e3c-92a8-01533e97c695 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:19.972246 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-82af5f3c-3b84-4e3c-92a8-01533e97c695 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:20.113154 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-82af5f3c-3b84-4e3c-92a8-01533e97c695 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:20.121074 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-82af5f3c-3b84-4e3c-92a8-01533e97c695 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.163845 Aug 17 23:53:20.121639 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 602/1222] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:19 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:20.402611 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-af396c2c-518c-4a40-a7c2-c40ccc96f4be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:20.403235 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-af396c2c-518c-4a40-a7c2-c40ccc96f4be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:20.410255 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af396c2c-518c-4a40-a7c2-c40ccc96f4be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:20.410740 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af396c2c-518c-4a40-a7c2-c40ccc96f4be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:20.411177 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af396c2c-518c-4a40-a7c2-c40ccc96f4be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:20.411868 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af396c2c-518c-4a40-a7c2-c40ccc96f4be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:20.412349 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af396c2c-518c-4a40-a7c2-c40ccc96f4be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:20.413038 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-af396c2c-518c-4a40-a7c2-c40ccc96f4be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:20.546963 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-af396c2c-518c-4a40-a7c2-c40ccc96f4be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:20.555353 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-af396c2c-518c-4a40-a7c2-c40ccc96f4be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:20.556990 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-af396c2c-518c-4a40-a7c2-c40ccc96f4be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:20.558270 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-af396c2c-518c-4a40-a7c2-c40ccc96f4be tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1729 microversion: 2.20 time: 0.159537 Aug 17 23:53:20.558990 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 621/1223] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:53:20 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:53:21.141786 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-30a52122-f9a2-421b-a8f8-992c6e9f81b1 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:21.142438 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-30a52122-f9a2-421b-a8f8-992c6e9f81b1 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:21.148936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30a52122-f9a2-421b-a8f8-992c6e9f81b1 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:21.149418 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30a52122-f9a2-421b-a8f8-992c6e9f81b1 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:21.149848 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30a52122-f9a2-421b-a8f8-992c6e9f81b1 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:21.150536 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30a52122-f9a2-421b-a8f8-992c6e9f81b1 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:21.150988 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30a52122-f9a2-421b-a8f8-992c6e9f81b1 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:21.151404 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-30a52122-f9a2-421b-a8f8-992c6e9f81b1 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:21.282548 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-30a52122-f9a2-421b-a8f8-992c6e9f81b1 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:21.290371 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-30a52122-f9a2-421b-a8f8-992c6e9f81b1 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.152530 Aug 17 23:53:21.290936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 603/1224] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:21 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:21.581477 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a1fe2eee-273a-4dc9-b478-443630055a5b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:21.582024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a1fe2eee-273a-4dc9-b478-443630055a5b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:21.588362 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1fe2eee-273a-4dc9-b478-443630055a5b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:21.588840 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1fe2eee-273a-4dc9-b478-443630055a5b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:21.589274 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1fe2eee-273a-4dc9-b478-443630055a5b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:21.589952 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1fe2eee-273a-4dc9-b478-443630055a5b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:21.590399 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1fe2eee-273a-4dc9-b478-443630055a5b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:21.590819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1fe2eee-273a-4dc9-b478-443630055a5b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:21.720724 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a1fe2eee-273a-4dc9-b478-443630055a5b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:21.731086 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a1fe2eee-273a-4dc9-b478-443630055a5b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:21.732916 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-a1fe2eee-273a-4dc9-b478-443630055a5b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:21.734295 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a1fe2eee-273a-4dc9-b478-443630055a5b tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1716 microversion: 2.20 time: 0.156877 Aug 17 23:53:21.735504 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 622/1225] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:53:21 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:53:22.310628 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9c16a2ba-3cf5-4f4a-abe2-71b385a3b28d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:22.311295 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9c16a2ba-3cf5-4f4a-abe2-71b385a3b28d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:22.318132 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9c16a2ba-3cf5-4f4a-abe2-71b385a3b28d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:22.318611 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9c16a2ba-3cf5-4f4a-abe2-71b385a3b28d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:22.319046 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9c16a2ba-3cf5-4f4a-abe2-71b385a3b28d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:22.319730 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9c16a2ba-3cf5-4f4a-abe2-71b385a3b28d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:22.320214 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9c16a2ba-3cf5-4f4a-abe2-71b385a3b28d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:22.320640 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9c16a2ba-3cf5-4f4a-abe2-71b385a3b28d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:22.530504 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9c16a2ba-3cf5-4f4a-abe2-71b385a3b28d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:22.538260 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9c16a2ba-3cf5-4f4a-abe2-71b385a3b28d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1569 microversion: 2.1 time: 0.231204 Aug 17 23:53:22.538948 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 604/1226] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:22 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1569 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:23.113429 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-e8a54d27-aecc-437b-a870-16c839429788 req-34badb16-14ce-4ea0-b5c7-2762868f1a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93126672-4679-41e5-bfbd-f06836afac17", "name": "network-vif-deleted", "tag": "da8d102a-c017-4932-bfb8-b3ef13097d11"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:53:23.124587 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-e8a54d27-aecc-437b-a870-16c839429788 req-34badb16-14ce-4ea0-b5c7-2762868f1a12 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:23.125071 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-e8a54d27-aecc-437b-a870-16c839429788 req-34badb16-14ce-4ea0-b5c7-2762868f1a12 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:23.125507 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-e8a54d27-aecc-437b-a870-16c839429788 req-34badb16-14ce-4ea0-b5c7-2762868f1a12 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:23.136736 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-e8a54d27-aecc-437b-a870-16c839429788 req-34badb16-14ce-4ea0-b5c7-2762868f1a12 service nova] Creating event network-vif-deleted:da8d102a-c017-4932-bfb8-b3ef13097d11 for instance 93126672-4679-41e5-bfbd-f06836afac17 on hv-cinder-82002 Aug 17 23:53:23.142244 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-e8a54d27-aecc-437b-a870-16c839429788 req-34badb16-14ce-4ea0-b5c7-2762868f1a12 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033214 Aug 17 23:53:23.142851 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 623/1227] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:53:23.559942 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9196acca-64b2-4593-ae5a-ad8e25e3380b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:23.560571 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9196acca-64b2-4593-ae5a-ad8e25e3380b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:23.567426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9196acca-64b2-4593-ae5a-ad8e25e3380b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:23.567905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9196acca-64b2-4593-ae5a-ad8e25e3380b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:23.568369 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9196acca-64b2-4593-ae5a-ad8e25e3380b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:23.569055 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9196acca-64b2-4593-ae5a-ad8e25e3380b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:23.569504 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9196acca-64b2-4593-ae5a-ad8e25e3380b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:23.569924 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9196acca-64b2-4593-ae5a-ad8e25e3380b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:23.632376 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9196acca-64b2-4593-ae5a-ad8e25e3380b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:23.639681 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9196acca-64b2-4593-ae5a-ad8e25e3380b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1220 microversion: 2.1 time: 0.083692 Aug 17 23:53:23.640393 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 605/1228] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:23 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:24.661443 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-76f3b467-3619-46fb-834b-ee638b966017 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:24.662206 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-76f3b467-3619-46fb-834b-ee638b966017 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:24.669100 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-76f3b467-3619-46fb-834b-ee638b966017 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:24.669582 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-76f3b467-3619-46fb-834b-ee638b966017 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:24.670019 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-76f3b467-3619-46fb-834b-ee638b966017 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:24.670700 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-76f3b467-3619-46fb-834b-ee638b966017 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:24.671155 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-76f3b467-3619-46fb-834b-ee638b966017 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:24.671577 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-76f3b467-3619-46fb-834b-ee638b966017 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:24.733296 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-76f3b467-3619-46fb-834b-ee638b966017 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:24.740792 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-76f3b467-3619-46fb-834b-ee638b966017 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1220 microversion: 2.1 time: 0.084155 Aug 17 23:53:24.741356 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 624/1229] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:24 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:25.761379 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-6eea5f30-767d-4038-b78f-732d4d3c4d9e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:25.762019 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-6eea5f30-767d-4038-b78f-732d4d3c4d9e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:25.768529 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6eea5f30-767d-4038-b78f-732d4d3c4d9e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:25.769019 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6eea5f30-767d-4038-b78f-732d4d3c4d9e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:25.769454 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6eea5f30-767d-4038-b78f-732d4d3c4d9e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:25.770147 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6eea5f30-767d-4038-b78f-732d4d3c4d9e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:25.770603 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6eea5f30-767d-4038-b78f-732d4d3c4d9e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:25.771030 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6eea5f30-767d-4038-b78f-732d4d3c4d9e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:25.831006 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-6eea5f30-767d-4038-b78f-732d4d3c4d9e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:25.838513 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-6eea5f30-767d-4038-b78f-732d4d3c4d9e tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1220 microversion: 2.1 time: 0.080997 Aug 17 23:53:25.839073 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 606/1230] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:25 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:26.059755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-59ce042c-f218-40f6-bd34-d5af9e984a2c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1477607097", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1844905335", "security_groups": [{"name": "tempest-secgroup-smoke-1359277404"}], "block_device_mapping_v2": [{"uuid": "742442ce-b3f6-4c71-83e2-685d21f98243", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "767a2b34-2391-4975-a5de-d7b63e2cf978"}]}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:53:26.170838 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.network.neutron [None req-59ce042c-f218-40f6-bd34-d5af9e984a2c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] validate_networks() for [('767a2b34-2391-4975-a5de-d7b63e2cf978', None, None, None, None, None)] {{(pid=131394) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:53:26.534811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-59ce042c-f218-40f6-bd34-d5af9e984a2c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Flavor limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:53:26.535230 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-59ce042c-f218-40f6-bd34-d5af9e984a2c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Image limits 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:53:26.535699 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-59ce042c-f218-40f6-bd34-d5af9e984a2c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Flavor pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:53:26.536150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-59ce042c-f218-40f6-bd34-d5af9e984a2c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Image pref 0:0:0 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:53:26.536558 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.virt.hardware [None req-59ce042c-f218-40f6-bd34-d5af9e984a2c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131394) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:53:26.545272 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-59ce042c-f218-40f6-bd34-d5af9e984a2c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:26.545749 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-59ce042c-f218-40f6-bd34-d5af9e984a2c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:26.546181 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-59ce042c-f218-40f6-bd34-d5af9e984a2c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:26.547372 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-59ce042c-f218-40f6-bd34-d5af9e984a2c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:26.548009 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-59ce042c-f218-40f6-bd34-d5af9e984a2c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:26.548442 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-59ce042c-f218-40f6-bd34-d5af9e984a2c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:26.566229 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-59ce042c-f218-40f6-bd34-d5af9e984a2c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Getting quotas for project 8e81ed7b06f84b2bab3369334cb1f90a. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:53:26.570125 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.quota [None req-59ce042c-f218-40f6-bd34-d5af9e984a2c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Getting quotas for user cf6e346e96144628ac25c428be38870a and project 8e81ed7b06f84b2bab3369334cb1f90a. Resources: {'ram', 'cores', 'instances'} {{(pid=131394) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:53:26.624439 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-59ce042c-f218-40f6-bd34-d5af9e984a2c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Going to run 1 instances... {{(pid=131394) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:53:26.627183 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-59ce042c-f218-40f6-bd34-d5af9e984a2c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='742442ce-b3f6-4c71-83e2-685d21f98243',volume_size=None,volume_type=None)] {{(pid=131394) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:53:26.749429 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-59ce042c-f218-40f6-bd34-d5af9e984a2c tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.693429 Aug 17 23:53:26.750579 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 625/1231] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 17 23:53:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 23:53:26.761353 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ac21cb51-aaea-4631-a88f-46b3601ea3bc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:26.762052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ac21cb51-aaea-4631-a88f-46b3601ea3bc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:26.816721 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ac21cb51-aaea-4631-a88f-46b3601ea3bc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:26.823498 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ac21cb51-aaea-4631-a88f-46b3601ea3bc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1095 microversion: 2.1 time: 0.066108 Aug 17 23:53:26.824098 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 607/1232] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:26 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:26.861569 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d3677ae6-cedc-48e0-8f59-0c2150aaf4fd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:26.862216 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d3677ae6-cedc-48e0-8f59-0c2150aaf4fd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:26.868729 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d3677ae6-cedc-48e0-8f59-0c2150aaf4fd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:26.869271 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d3677ae6-cedc-48e0-8f59-0c2150aaf4fd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:26.869654 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d3677ae6-cedc-48e0-8f59-0c2150aaf4fd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:26.870312 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d3677ae6-cedc-48e0-8f59-0c2150aaf4fd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:26.870803 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d3677ae6-cedc-48e0-8f59-0c2150aaf4fd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:26.871184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d3677ae6-cedc-48e0-8f59-0c2150aaf4fd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:26.935254 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d3677ae6-cedc-48e0-8f59-0c2150aaf4fd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:26.943656 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d3677ae6-cedc-48e0-8f59-0c2150aaf4fd tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1220 microversion: 2.1 time: 0.086437 Aug 17 23:53:26.944252 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 626/1233] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:26 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:53:27.844628 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-16dc4f75-e2f2-4485-91e5-8760dbb05de5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:27.845251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-16dc4f75-e2f2-4485-91e5-8760dbb05de5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:27.852614 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-16dc4f75-e2f2-4485-91e5-8760dbb05de5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:27.853106 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-16dc4f75-e2f2-4485-91e5-8760dbb05de5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:27.853549 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-16dc4f75-e2f2-4485-91e5-8760dbb05de5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:27.854249 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-16dc4f75-e2f2-4485-91e5-8760dbb05de5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:27.854745 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-16dc4f75-e2f2-4485-91e5-8760dbb05de5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:27.855233 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-16dc4f75-e2f2-4485-91e5-8760dbb05de5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:27.918266 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-16dc4f75-e2f2-4485-91e5-8760dbb05de5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:27.925705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-16dc4f75-e2f2-4485-91e5-8760dbb05de5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1145 microversion: 2.1 time: 0.085617 Aug 17 23:53:27.926278 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 608/1234] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:27 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:27.964624 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-fdc93fa5-c627-4180-8131-1a02902d00fa tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:27.965262 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-fdc93fa5-c627-4180-8131-1a02902d00fa tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:27.972361 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fdc93fa5-c627-4180-8131-1a02902d00fa tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:27.972851 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fdc93fa5-c627-4180-8131-1a02902d00fa tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:27.973288 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fdc93fa5-c627-4180-8131-1a02902d00fa tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:27.973981 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fdc93fa5-c627-4180-8131-1a02902d00fa tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:27.974439 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fdc93fa5-c627-4180-8131-1a02902d00fa tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:27.974867 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fdc93fa5-c627-4180-8131-1a02902d00fa tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:27.989578 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:53:28.045098 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-fdc93fa5-c627-4180-8131-1a02902d00fa tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:28.052554 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-fdc93fa5-c627-4180-8131-1a02902d00fa tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1220 microversion: 2.1 time: 0.091765 Aug 17 23:53:28.053119 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 627/1235] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:27 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:28.945637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c5f5f5bc-fe3d-4a84-a6d6-5c5a5ab89e85 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:28.946251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c5f5f5bc-fe3d-4a84-a6d6-5c5a5ab89e85 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:28.952585 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c5f5f5bc-fe3d-4a84-a6d6-5c5a5ab89e85 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:28.953065 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c5f5f5bc-fe3d-4a84-a6d6-5c5a5ab89e85 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:28.953527 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c5f5f5bc-fe3d-4a84-a6d6-5c5a5ab89e85 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:28.954211 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c5f5f5bc-fe3d-4a84-a6d6-5c5a5ab89e85 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:28.954661 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c5f5f5bc-fe3d-4a84-a6d6-5c5a5ab89e85 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:28.955080 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c5f5f5bc-fe3d-4a84-a6d6-5c5a5ab89e85 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:29.015554 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c5f5f5bc-fe3d-4a84-a6d6-5c5a5ab89e85 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:29.023101 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c5f5f5bc-fe3d-4a84-a6d6-5c5a5ab89e85 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1145 microversion: 2.1 time: 0.081313 Aug 17 23:53:29.023665 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 609/1236] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:28 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:29.073669 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-379870fb-fe29-41c9-bc1c-be30c675d670 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:29.074318 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-379870fb-fe29-41c9-bc1c-be30c675d670 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:29.080798 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-379870fb-fe29-41c9-bc1c-be30c675d670 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:29.081278 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-379870fb-fe29-41c9-bc1c-be30c675d670 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:29.081716 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-379870fb-fe29-41c9-bc1c-be30c675d670 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:29.082431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-379870fb-fe29-41c9-bc1c-be30c675d670 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:29.082887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-379870fb-fe29-41c9-bc1c-be30c675d670 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:29.083312 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-379870fb-fe29-41c9-bc1c-be30c675d670 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:29.142874 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-379870fb-fe29-41c9-bc1c-be30c675d670 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:29.150436 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-379870fb-fe29-41c9-bc1c-be30c675d670 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1220 microversion: 2.1 time: 0.080639 Aug 17 23:53:29.150999 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 628/1237] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:29 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:30.044631 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ae9fa042-471e-441a-964c-91c50ead4b4e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:30.045286 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ae9fa042-471e-441a-964c-91c50ead4b4e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:30.052311 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ae9fa042-471e-441a-964c-91c50ead4b4e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:30.052801 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ae9fa042-471e-441a-964c-91c50ead4b4e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:30.053244 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ae9fa042-471e-441a-964c-91c50ead4b4e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:30.054116 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ae9fa042-471e-441a-964c-91c50ead4b4e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:30.054579 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ae9fa042-471e-441a-964c-91c50ead4b4e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:30.055014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ae9fa042-471e-441a-964c-91c50ead4b4e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:30.122462 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ae9fa042-471e-441a-964c-91c50ead4b4e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:30.130453 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ae9fa042-471e-441a-964c-91c50ead4b4e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1137 microversion: 2.1 time: 0.089770 Aug 17 23:53:30.131014 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 610/1238] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:30 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:30.171399 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f2d33be8-c011-4e1d-a410-3530cb16109a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:30.172549 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f2d33be8-c011-4e1d-a410-3530cb16109a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:30.178956 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2d33be8-c011-4e1d-a410-3530cb16109a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:30.179442 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2d33be8-c011-4e1d-a410-3530cb16109a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:30.179885 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2d33be8-c011-4e1d-a410-3530cb16109a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:30.180605 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2d33be8-c011-4e1d-a410-3530cb16109a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:30.181066 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2d33be8-c011-4e1d-a410-3530cb16109a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:30.181494 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f2d33be8-c011-4e1d-a410-3530cb16109a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:30.246531 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f2d33be8-c011-4e1d-a410-3530cb16109a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:30.254190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f2d33be8-c011-4e1d-a410-3530cb16109a tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1220 microversion: 2.1 time: 0.086563 Aug 17 23:53:30.260546 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 629/1239] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:30 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:31.154665 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-4ba5cb95-b722-4948-b612-7b1687dc099e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:31.155360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-4ba5cb95-b722-4948-b612-7b1687dc099e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:31.163860 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4ba5cb95-b722-4948-b612-7b1687dc099e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:31.164897 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4ba5cb95-b722-4948-b612-7b1687dc099e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:31.165267 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4ba5cb95-b722-4948-b612-7b1687dc099e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:31.165982 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4ba5cb95-b722-4948-b612-7b1687dc099e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:31.166442 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4ba5cb95-b722-4948-b612-7b1687dc099e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:31.166880 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-4ba5cb95-b722-4948-b612-7b1687dc099e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:31.171056 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:53:31.237556 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-4ba5cb95-b722-4948-b612-7b1687dc099e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:31.245331 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-4ba5cb95-b722-4948-b612-7b1687dc099e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1193 microversion: 2.1 time: 0.096670 Aug 17 23:53:31.245897 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 611/1240] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:31 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:31.274414 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f1bad400-758f-4542-be44-11698092be8b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:31.275056 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-f1bad400-758f-4542-be44-11698092be8b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:31.281566 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f1bad400-758f-4542-be44-11698092be8b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:31.282046 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f1bad400-758f-4542-be44-11698092be8b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:31.282483 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f1bad400-758f-4542-be44-11698092be8b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:31.283167 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f1bad400-758f-4542-be44-11698092be8b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:31.283622 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f1bad400-758f-4542-be44-11698092be8b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:31.284088 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f1bad400-758f-4542-be44-11698092be8b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:31.313735 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f1bad400-758f-4542-be44-11698092be8b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:31.314217 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f1bad400-758f-4542-be44-11698092be8b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:31.314635 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-f1bad400-758f-4542-be44-11698092be8b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:31.315074 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.objects.instance [None req-f1bad400-758f-4542-be44-11698092be8b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lazy-loading 'fault' on Instance uuid 93126672-4679-41e5-bfbd-f06836afac17 {{(pid=131394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:53:31.354940 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-f1bad400-758f-4542-be44-11698092be8b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b5129d46345ef99c69e95f9824c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac208652b8247049fa6a0bc9aa991bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:31.362379 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f1bad400-758f-4542-be44-11698092be8b tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 200 len: 1225 microversion: 2.1 time: 0.091703 Aug 17 23:53:31.362938 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 630/1241] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:31 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:32.267110 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3d98cb99-c266-4159-98c6-c9bb03dbc1c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:32.267760 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3d98cb99-c266-4159-98c6-c9bb03dbc1c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:32.274099 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3d98cb99-c266-4159-98c6-c9bb03dbc1c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:32.274587 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3d98cb99-c266-4159-98c6-c9bb03dbc1c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:32.275025 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3d98cb99-c266-4159-98c6-c9bb03dbc1c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:32.275722 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3d98cb99-c266-4159-98c6-c9bb03dbc1c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:32.276209 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3d98cb99-c266-4159-98c6-c9bb03dbc1c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:32.276636 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3d98cb99-c266-4159-98c6-c9bb03dbc1c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:32.353746 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3d98cb99-c266-4159-98c6-c9bb03dbc1c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:32.361761 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3d98cb99-c266-4159-98c6-c9bb03dbc1c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1211 microversion: 2.1 time: 0.099135 Aug 17 23:53:32.362552 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 612/1242] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:32 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:32.383012 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-87cf644f-9f2a-42d0-b3f0-24f1fc21495d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:32.383583 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-87cf644f-9f2a-42d0-b3f0-24f1fc21495d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] [instance: 93126672-4679-41e5-bfbd-f06836afac17] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:32.390153 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87cf644f-9f2a-42d0-b3f0-24f1fc21495d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:32.391185 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87cf644f-9f2a-42d0-b3f0-24f1fc21495d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:32.391638 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87cf644f-9f2a-42d0-b3f0-24f1fc21495d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:32.392370 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87cf644f-9f2a-42d0-b3f0-24f1fc21495d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:32.393011 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87cf644f-9f2a-42d0-b3f0-24f1fc21495d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:32.393607 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87cf644f-9f2a-42d0-b3f0-24f1fc21495d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:32.407693 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-87cf644f-9f2a-42d0-b3f0-24f1fc21495d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] HTTP exception thrown: Instance 93126672-4679-41e5-bfbd-f06836afac17 could not be found. Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-87cf644f-9f2a-42d0-b3f0-24f1fc21495d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Request method failure captured: Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 HTTP/1.1 Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X3at5Dwds5WS625xsjut7r4lnW0EbP0651K6PJEUoR9Wr32eT-Vv2WML4q4CnMGWhayaT9WgtSBbmG9kie7Fampt8uw_4dFN9LqY1X1K7R1opMVUiAADxcP6mStI8fS380_1WkQXJesKX8v_e4N-Bm03Ho_4vUtL3WrO0vFzLuwn0o Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: aac208652b8247049fa6a0bc9aa991bf Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-TestShelveInstance-2027121933 Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:53:32.409402 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:53:32.411077 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aac208652b8247049fa6a0bc9aa991bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aac208652b8247049fa6a0bc9aa991bf", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aac208652b8247049fa6a0bc9aa991bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aac208652b8247049fa6a0bc9aa991bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:53:32.411077 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-TestShelveInstance-2027121933 Aug 17 23:53:32.411077 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: aac208652b8247049fa6a0bc9aa991bf Aug 17 23:53:32.411077 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-TestShelveInstance-2027121933 Aug 17 23:53:32.411077 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-TestShelveInstance-2027121933-project Aug 17 23:53:32.411077 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:53:32.411077 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:53:32.411077 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: ce1b5129d46345ef99c69e95f9824c45 Aug 17 23:53:32.411077 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-TestShelveInstance-2027121933-project Aug 17 23:53:32.411077 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:53:32.411077 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance 93126672-4679-41e5-bfbd-f06836afac17 could not be found. Aug 17 23:53:32.411077 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': '93126672-4679-41e5-bfbd-f06836afac17'} Aug 17 23:53:32.412148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:53:32.412148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:53:32.412148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:53:32.412148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:53:32.412148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:53:32.412148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:53:32.412148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:53:32.412148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:53:32.412148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:53:32.412148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:53:32.412148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93126672-4679-41e5-bfbd-f06836afac17 could not be found. Aug 17 23:53:32.412148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:53:32.412148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:53:32.412148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:53:32.412148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:53:32.412148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:53:32.412148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:53:32.412148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:53:32.412148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:53:32.412148 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:53:32.413755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:53:32.413755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:53:32.413755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:53:32.413755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:53:32.413755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:53:32.413755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:53:32.413755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:53:32.413755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93126672-4679-41e5-bfbd-f06836afac17 could not be found. Aug 17 23:53:32.413755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:53:32.413755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:53:32.413755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:53:32.413755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:53:32.413755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:53:32.413755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:53:32.413755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:53:32.413755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:53:32.413755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93126672-4679-41e5-bfbd-f06836afac17 could not be found. Aug 17 23:53:32.413755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:53:32.415045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-87cf644f-9f2a-42d0-b3f0-24f1fc21495d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Returning 404 to user: Instance 93126672-4679-41e5-bfbd-f06836afac17 could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:53:32.415045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-87cf644f-9f2a-42d0-b3f0-24f1fc21495d tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17" status: 404 len: 111 microversion: 2.1 time: 0.032013 Aug 17 23:53:32.415045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 631/1243] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:32 2022] GET /compute/v2.1/servers/93126672-4679-41e5-bfbd-f06836afac17 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:53:32.582289 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-2c3389d2-9f14-474b-a3d4-852996581892 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] Calling method '.version_select at 0x7f85fe29fa60>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:32.604623 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-2c3389d2-9f14-474b-a3d4-852996581892 tempest-TestShelveInstance-2027121933 tempest-TestShelveInstance-2027121933-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1853072573" status: 202 len: 0 microversion: 2.1 time: 0.026777 Aug 17 23:53:32.605296 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 613/1244] 10.222.0.26 () {58 vars in 1254 bytes} [Wed Aug 17 23:53:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1853072573 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:53:33.382627 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e7cce933-2d32-4877-93fc-da88daaa82e5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:33.383384 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e7cce933-2d32-4877-93fc-da88daaa82e5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:33.389613 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e7cce933-2d32-4877-93fc-da88daaa82e5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:33.390102 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e7cce933-2d32-4877-93fc-da88daaa82e5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:33.390542 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e7cce933-2d32-4877-93fc-da88daaa82e5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:33.391242 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e7cce933-2d32-4877-93fc-da88daaa82e5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:33.391880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e7cce933-2d32-4877-93fc-da88daaa82e5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:33.392337 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e7cce933-2d32-4877-93fc-da88daaa82e5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:33.605198 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e7cce933-2d32-4877-93fc-da88daaa82e5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:33.618223 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e7cce933-2d32-4877-93fc-da88daaa82e5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1279 microversion: 2.1 time: 0.239310 Aug 17 23:53:33.618905 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 632/1245] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:33 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1279 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:34.639355 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c83c834a-af10-4b89-873f-b6c0a857d463 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:34.640820 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c83c834a-af10-4b89-873f-b6c0a857d463 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:34.646777 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c83c834a-af10-4b89-873f-b6c0a857d463 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:34.647259 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c83c834a-af10-4b89-873f-b6c0a857d463 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:34.647689 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c83c834a-af10-4b89-873f-b6c0a857d463 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:34.648405 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c83c834a-af10-4b89-873f-b6c0a857d463 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:34.648857 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c83c834a-af10-4b89-873f-b6c0a857d463 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:34.649279 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c83c834a-af10-4b89-873f-b6c0a857d463 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:34.790156 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c83c834a-af10-4b89-873f-b6c0a857d463 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:34.798533 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c83c834a-af10-4b89-873f-b6c0a857d463 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1279 microversion: 2.1 time: 0.163567 Aug 17 23:53:34.799114 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 614/1246] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:34 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1279 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:35.823396 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-bc06a5cf-070c-44a2-b9f0-addf9b33ce94 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:35.825590 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-bc06a5cf-070c-44a2-b9f0-addf9b33ce94 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:35.835090 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:53:35.840842 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bc06a5cf-070c-44a2-b9f0-addf9b33ce94 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:35.841967 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bc06a5cf-070c-44a2-b9f0-addf9b33ce94 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:35.843648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bc06a5cf-070c-44a2-b9f0-addf9b33ce94 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:35.845752 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bc06a5cf-070c-44a2-b9f0-addf9b33ce94 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:35.847807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bc06a5cf-070c-44a2-b9f0-addf9b33ce94 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:35.848554 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bc06a5cf-070c-44a2-b9f0-addf9b33ce94 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:36.016645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-bc06a5cf-070c-44a2-b9f0-addf9b33ce94 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:36.024717 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-bc06a5cf-070c-44a2-b9f0-addf9b33ce94 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1279 microversion: 2.1 time: 0.209224 Aug 17 23:53:36.025298 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 633/1247] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:35 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1279 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:37.053215 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0942a800-e4fb-4bf7-b46c-1afdbd1c475b tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:37.054110 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0942a800-e4fb-4bf7-b46c-1afdbd1c475b tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:37.056962 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:53:37.058140 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:53:37.088456 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0942a800-e4fb-4bf7-b46c-1afdbd1c475b tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:37.090561 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0942a800-e4fb-4bf7-b46c-1afdbd1c475b tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:37.092984 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0942a800-e4fb-4bf7-b46c-1afdbd1c475b tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:37.095620 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0942a800-e4fb-4bf7-b46c-1afdbd1c475b tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:37.096632 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0942a800-e4fb-4bf7-b46c-1afdbd1c475b tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:37.097571 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0942a800-e4fb-4bf7-b46c-1afdbd1c475b tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:37.146009 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-2ee1cb36-9109-43e6-9a4a-bcd9420f4008 req-88316557-97d2-4305-9bc6-70159543ab72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc", "tag": "2319edc7-eacd-41d6-8e52-fbb209f31acd"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:53:37.172682 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=2 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:53:37.175712 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=6 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:53:37.181174 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-2ee1cb36-9109-43e6-9a4a-bcd9420f4008 req-88316557-97d2-4305-9bc6-70159543ab72 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:37.181809 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-2ee1cb36-9109-43e6-9a4a-bcd9420f4008 req-88316557-97d2-4305-9bc6-70159543ab72 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:37.185524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-2ee1cb36-9109-43e6-9a4a-bcd9420f4008 req-88316557-97d2-4305-9bc6-70159543ab72 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:37.224911 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-2ee1cb36-9109-43e6-9a4a-bcd9420f4008 req-88316557-97d2-4305-9bc6-70159543ab72 service nova] Creating event network-changed:2319edc7-eacd-41d6-8e52-fbb209f31acd for instance 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc on hv-cinder-82002 Aug 17 23:53:37.248550 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-2ee1cb36-9109-43e6-9a4a-bcd9420f4008 req-88316557-97d2-4305-9bc6-70159543ab72 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108169 Aug 17 23:53:37.252185 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 634/1248] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:53:37.359769 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0942a800-e4fb-4bf7-b46c-1afdbd1c475b tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:37.367488 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0942a800-e4fb-4bf7-b46c-1afdbd1c475b tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1279 microversion: 2.1 time: 0.322042 Aug 17 23:53:37.368217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 615/1249] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:37 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1279 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:38.390179 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b1739082-bdb9-408e-bff2-47b3c9e1b5cb tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:38.391440 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b1739082-bdb9-408e-bff2-47b3c9e1b5cb tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:38.397741 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b1739082-bdb9-408e-bff2-47b3c9e1b5cb tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:38.398230 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b1739082-bdb9-408e-bff2-47b3c9e1b5cb tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:38.398664 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b1739082-bdb9-408e-bff2-47b3c9e1b5cb tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:38.399361 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b1739082-bdb9-408e-bff2-47b3c9e1b5cb tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:38.399818 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b1739082-bdb9-408e-bff2-47b3c9e1b5cb tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:38.400268 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b1739082-bdb9-408e-bff2-47b3c9e1b5cb tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:38.613882 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-b1739082-bdb9-408e-bff2-47b3c9e1b5cb tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:38.621650 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b1739082-bdb9-408e-bff2-47b3c9e1b5cb tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1267 microversion: 2.1 time: 0.236264 Aug 17 23:53:38.622220 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 635/1250] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:38 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:39.642831 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-cd0c7d2c-4d40-48e3-abad-a722af93fe99 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:39.643442 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-cd0c7d2c-4d40-48e3-abad-a722af93fe99 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:39.650328 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cd0c7d2c-4d40-48e3-abad-a722af93fe99 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:39.650816 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cd0c7d2c-4d40-48e3-abad-a722af93fe99 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:39.651249 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cd0c7d2c-4d40-48e3-abad-a722af93fe99 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:39.652213 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cd0c7d2c-4d40-48e3-abad-a722af93fe99 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:39.652677 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cd0c7d2c-4d40-48e3-abad-a722af93fe99 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:39.653102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cd0c7d2c-4d40-48e3-abad-a722af93fe99 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:39.809525 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-cd0c7d2c-4d40-48e3-abad-a722af93fe99 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:39.818576 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-cd0c7d2c-4d40-48e3-abad-a722af93fe99 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1267 microversion: 2.1 time: 0.179744 Aug 17 23:53:39.819293 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 616/1251] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:39 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:40.840372 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1f46253c-9d4e-4249-8e32-f0f31897b8e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:40.841033 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1f46253c-9d4e-4249-8e32-f0f31897b8e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:40.848634 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1f46253c-9d4e-4249-8e32-f0f31897b8e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:40.849404 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1f46253c-9d4e-4249-8e32-f0f31897b8e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:40.850002 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1f46253c-9d4e-4249-8e32-f0f31897b8e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:40.850727 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1f46253c-9d4e-4249-8e32-f0f31897b8e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:40.851179 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1f46253c-9d4e-4249-8e32-f0f31897b8e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:40.851600 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1f46253c-9d4e-4249-8e32-f0f31897b8e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:40.993287 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1f46253c-9d4e-4249-8e32-f0f31897b8e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:41.003183 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1f46253c-9d4e-4249-8e32-f0f31897b8e3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1267 microversion: 2.1 time: 0.166687 Aug 17 23:53:41.016046 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 636/1252] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:40 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:42.024522 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-51a1deb3-8afb-4e17-9ddc-8364c676db72 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:42.025167 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-51a1deb3-8afb-4e17-9ddc-8364c676db72 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:42.031630 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-51a1deb3-8afb-4e17-9ddc-8364c676db72 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:42.032154 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-51a1deb3-8afb-4e17-9ddc-8364c676db72 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:42.032593 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-51a1deb3-8afb-4e17-9ddc-8364c676db72 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:42.033304 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-51a1deb3-8afb-4e17-9ddc-8364c676db72 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:42.033756 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-51a1deb3-8afb-4e17-9ddc-8364c676db72 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:42.034175 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-51a1deb3-8afb-4e17-9ddc-8364c676db72 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:42.167654 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-51a1deb3-8afb-4e17-9ddc-8364c676db72 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:42.176248 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-51a1deb3-8afb-4e17-9ddc-8364c676db72 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1267 microversion: 2.1 time: 0.155583 Aug 17 23:53:42.188251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 617/1253] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:42 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:43.197539 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-406a28fc-27bf-4f25-b398-c7e6d9c60ce1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:43.198150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-406a28fc-27bf-4f25-b398-c7e6d9c60ce1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:43.205216 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-406a28fc-27bf-4f25-b398-c7e6d9c60ce1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:43.205698 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-406a28fc-27bf-4f25-b398-c7e6d9c60ce1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:43.206128 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-406a28fc-27bf-4f25-b398-c7e6d9c60ce1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:43.206817 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-406a28fc-27bf-4f25-b398-c7e6d9c60ce1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:43.207265 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-406a28fc-27bf-4f25-b398-c7e6d9c60ce1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:43.207684 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-406a28fc-27bf-4f25-b398-c7e6d9c60ce1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:43.342981 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-406a28fc-27bf-4f25-b398-c7e6d9c60ce1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:43.350546 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-406a28fc-27bf-4f25-b398-c7e6d9c60ce1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1267 microversion: 2.1 time: 0.156893 Aug 17 23:53:43.351194 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 637/1254] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:43 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:44.371499 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-71398427-a663-40bf-8bd4-5c078edd6d0f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:44.372149 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-71398427-a663-40bf-8bd4-5c078edd6d0f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:44.378593 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-71398427-a663-40bf-8bd4-5c078edd6d0f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:44.379083 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-71398427-a663-40bf-8bd4-5c078edd6d0f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:44.379525 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-71398427-a663-40bf-8bd4-5c078edd6d0f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:44.380253 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-71398427-a663-40bf-8bd4-5c078edd6d0f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:44.380716 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-71398427-a663-40bf-8bd4-5c078edd6d0f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:44.381144 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-71398427-a663-40bf-8bd4-5c078edd6d0f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:44.512917 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-71398427-a663-40bf-8bd4-5c078edd6d0f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:44.521063 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-71398427-a663-40bf-8bd4-5c078edd6d0f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1267 microversion: 2.1 time: 0.153548 Aug 17 23:53:44.521634 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 618/1255] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:44 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:45.542547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-de1fec0f-d537-4fe1-8efe-614628762ba5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:45.543165 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-de1fec0f-d537-4fe1-8efe-614628762ba5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:45.550300 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de1fec0f-d537-4fe1-8efe-614628762ba5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:45.550783 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de1fec0f-d537-4fe1-8efe-614628762ba5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:45.551223 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de1fec0f-d537-4fe1-8efe-614628762ba5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:45.551909 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de1fec0f-d537-4fe1-8efe-614628762ba5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:45.552393 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de1fec0f-d537-4fe1-8efe-614628762ba5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:45.552815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-de1fec0f-d537-4fe1-8efe-614628762ba5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:45.681166 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-de1fec0f-d537-4fe1-8efe-614628762ba5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:45.688588 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-de1fec0f-d537-4fe1-8efe-614628762ba5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1267 microversion: 2.1 time: 0.150242 Aug 17 23:53:45.689179 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 638/1256] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:45 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:45.748563 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9ee3dba4-6827-44b3-a349-78cc11f78988 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:45.749167 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9ee3dba4-6827-44b3-a349-78cc11f78988 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:45.755420 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9ee3dba4-6827-44b3-a349-78cc11f78988 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:45.755897 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9ee3dba4-6827-44b3-a349-78cc11f78988 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:45.756363 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9ee3dba4-6827-44b3-a349-78cc11f78988 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:45.757044 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9ee3dba4-6827-44b3-a349-78cc11f78988 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:45.757494 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9ee3dba4-6827-44b3-a349-78cc11f78988 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:45.757915 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9ee3dba4-6827-44b3-a349-78cc11f78988 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:45.836712 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.objects.instance [None req-9ee3dba4-6827-44b3-a349-78cc11f78988 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lazy-loading 'services' on Instance uuid 1edaabd4-258c-42f9-bafb-0c574cd21217 {{(pid=131395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:53:45.909961 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9ee3dba4-6827-44b3-a349-78cc11f78988 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217/os-volume_attachments/6abeb35a-c240-489b-b451-cdad864a126d" status: 202 len: 0 microversion: 2.1 time: 0.165050 Aug 17 23:53:45.910527 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 619/1257] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 17 23:53:45 2022] DELETE /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217/os-volume_attachments/6abeb35a-c240-489b-b451-cdad864a126d => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:53:46.708263 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-0d130255-b47c-48b3-82c4-42b664586143 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:46.708855 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-0d130255-b47c-48b3-82c4-42b664586143 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:46.715176 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d130255-b47c-48b3-82c4-42b664586143 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:46.715659 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d130255-b47c-48b3-82c4-42b664586143 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:46.716137 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d130255-b47c-48b3-82c4-42b664586143 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:46.716827 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d130255-b47c-48b3-82c4-42b664586143 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:46.717281 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d130255-b47c-48b3-82c4-42b664586143 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:46.717707 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0d130255-b47c-48b3-82c4-42b664586143 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:46.853584 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0d130255-b47c-48b3-82c4-42b664586143 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:46.862002 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-0d130255-b47c-48b3-82c4-42b664586143 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1267 microversion: 2.1 time: 0.157686 Aug 17 23:53:46.862560 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 639/1258] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:46 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:47.883624 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0eec6247-5e09-4a0a-89b6-0237d1f88814 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:47.884343 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0eec6247-5e09-4a0a-89b6-0237d1f88814 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:47.890502 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0eec6247-5e09-4a0a-89b6-0237d1f88814 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:47.891528 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0eec6247-5e09-4a0a-89b6-0237d1f88814 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:47.891986 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0eec6247-5e09-4a0a-89b6-0237d1f88814 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:47.892699 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0eec6247-5e09-4a0a-89b6-0237d1f88814 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:47.893149 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0eec6247-5e09-4a0a-89b6-0237d1f88814 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:47.893595 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0eec6247-5e09-4a0a-89b6-0237d1f88814 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:48.024136 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0eec6247-5e09-4a0a-89b6-0237d1f88814 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:48.031539 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0eec6247-5e09-4a0a-89b6-0237d1f88814 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1267 microversion: 2.1 time: 0.152780 Aug 17 23:53:48.032323 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 620/1259] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:47 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:48.092084 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a1332864-093b-43d8-98c3-60d1dce88d5e tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:48.092636 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a1332864-093b-43d8-98c3-60d1dce88d5e tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:48.099453 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1332864-093b-43d8-98c3-60d1dce88d5e tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:48.099934 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1332864-093b-43d8-98c3-60d1dce88d5e tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:48.100403 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1332864-093b-43d8-98c3-60d1dce88d5e tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:48.101080 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1332864-093b-43d8-98c3-60d1dce88d5e tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:48.101527 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1332864-093b-43d8-98c3-60d1dce88d5e tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:48.101946 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-a1332864-093b-43d8-98c3-60d1dce88d5e tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:48.129818 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-a1332864-093b-43d8-98c3-60d1dce88d5e tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Going to try to terminate instance {{(pid=131394) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:53:48.204783 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a1332864-093b-43d8-98c3-60d1dce88d5e tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217" status: 204 len: 0 microversion: 2.1 time: 0.116071 Aug 17 23:53:48.205393 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 640/1260] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:53:48 2022] DELETE /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 23:53:48.213578 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0dac559a-3553-47f0-aaea-ecc1bae484a8 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:48.214183 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0dac559a-3553-47f0-aaea-ecc1bae484a8 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:48.221542 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0dac559a-3553-47f0-aaea-ecc1bae484a8 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:48.222034 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0dac559a-3553-47f0-aaea-ecc1bae484a8 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:48.222472 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0dac559a-3553-47f0-aaea-ecc1bae484a8 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:48.223248 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0dac559a-3553-47f0-aaea-ecc1bae484a8 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:48.223702 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0dac559a-3553-47f0-aaea-ecc1bae484a8 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:48.224160 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0dac559a-3553-47f0-aaea-ecc1bae484a8 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:48.357685 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-0dac559a-3553-47f0-aaea-ecc1bae484a8 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:48.366084 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0dac559a-3553-47f0-aaea-ecc1bae484a8 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217" status: 200 len: 1514 microversion: 2.1 time: 0.156396 Aug 17 23:53:48.366662 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 621/1261] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:48 2022] GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:49.053584 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-5d5d0c68-a916-4a79-bd64-710b99e633d5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:49.054294 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-5d5d0c68-a916-4a79-bd64-710b99e633d5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:49.060269 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5d5d0c68-a916-4a79-bd64-710b99e633d5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:49.060763 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5d5d0c68-a916-4a79-bd64-710b99e633d5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:49.061204 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5d5d0c68-a916-4a79-bd64-710b99e633d5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:49.061896 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5d5d0c68-a916-4a79-bd64-710b99e633d5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:49.062384 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5d5d0c68-a916-4a79-bd64-710b99e633d5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:49.063332 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5d5d0c68-a916-4a79-bd64-710b99e633d5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:49.191942 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5d5d0c68-a916-4a79-bd64-710b99e633d5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:49.199461 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-5d5d0c68-a916-4a79-bd64-710b99e633d5 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1267 microversion: 2.1 time: 0.150083 Aug 17 23:53:49.200047 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 641/1262] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:49 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:49.387259 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-9643475f-8de1-4303-bbdd-27fa6e7eae72 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:49.387865 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-9643475f-8de1-4303-bbdd-27fa6e7eae72 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:49.394370 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9643475f-8de1-4303-bbdd-27fa6e7eae72 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:49.394851 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9643475f-8de1-4303-bbdd-27fa6e7eae72 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:49.395308 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9643475f-8de1-4303-bbdd-27fa6e7eae72 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:49.396052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9643475f-8de1-4303-bbdd-27fa6e7eae72 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:49.396509 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9643475f-8de1-4303-bbdd-27fa6e7eae72 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:49.396960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-9643475f-8de1-4303-bbdd-27fa6e7eae72 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:49.523717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-9643475f-8de1-4303-bbdd-27fa6e7eae72 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:49.531235 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-9643475f-8de1-4303-bbdd-27fa6e7eae72 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217" status: 200 len: 1514 microversion: 2.1 time: 0.148176 Aug 17 23:53:49.531801 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 622/1263] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:49 2022] GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:50.221444 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-80e6bd81-21b8-4a33-8f37-7341dcf196bf tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:50.222061 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-80e6bd81-21b8-4a33-8f37-7341dcf196bf tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:50.228464 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-80e6bd81-21b8-4a33-8f37-7341dcf196bf tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:50.228947 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-80e6bd81-21b8-4a33-8f37-7341dcf196bf tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:50.229388 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-80e6bd81-21b8-4a33-8f37-7341dcf196bf tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:50.230091 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-80e6bd81-21b8-4a33-8f37-7341dcf196bf tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:50.230530 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-80e6bd81-21b8-4a33-8f37-7341dcf196bf tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:50.230961 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-80e6bd81-21b8-4a33-8f37-7341dcf196bf tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:50.358205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-80e6bd81-21b8-4a33-8f37-7341dcf196bf tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:50.365554 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-80e6bd81-21b8-4a33-8f37-7341dcf196bf tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1267 microversion: 2.1 time: 0.148677 Aug 17 23:53:50.366110 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 642/1264] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:50 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:50.552070 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-d20d6f7c-86c1-48c9-98ed-b9e015dc737c tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:50.552683 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-d20d6f7c-86c1-48c9-98ed-b9e015dc737c tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:50.559146 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d20d6f7c-86c1-48c9-98ed-b9e015dc737c tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:50.559550 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d20d6f7c-86c1-48c9-98ed-b9e015dc737c tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:50.560003 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d20d6f7c-86c1-48c9-98ed-b9e015dc737c tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:50.560689 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d20d6f7c-86c1-48c9-98ed-b9e015dc737c tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:50.561137 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d20d6f7c-86c1-48c9-98ed-b9e015dc737c tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:50.561557 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d20d6f7c-86c1-48c9-98ed-b9e015dc737c tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:50.688695 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d20d6f7c-86c1-48c9-98ed-b9e015dc737c tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:50.696277 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-d20d6f7c-86c1-48c9-98ed-b9e015dc737c tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217" status: 200 len: 1514 microversion: 2.1 time: 0.148040 Aug 17 23:53:50.696849 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 623/1265] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:50 2022] GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:51.386219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-2ebda3a8-c1da-4575-afc2-70f0ad189b74 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:51.386762 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-2ebda3a8-c1da-4575-afc2-70f0ad189b74 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:51.393221 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2ebda3a8-c1da-4575-afc2-70f0ad189b74 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:51.393711 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2ebda3a8-c1da-4575-afc2-70f0ad189b74 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:51.394151 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2ebda3a8-c1da-4575-afc2-70f0ad189b74 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:51.394848 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2ebda3a8-c1da-4575-afc2-70f0ad189b74 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:51.395307 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2ebda3a8-c1da-4575-afc2-70f0ad189b74 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:51.395738 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2ebda3a8-c1da-4575-afc2-70f0ad189b74 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:51.410615 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:53:51.530981 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-2ebda3a8-c1da-4575-afc2-70f0ad189b74 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:51.539329 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-2ebda3a8-c1da-4575-afc2-70f0ad189b74 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1267 microversion: 2.1 time: 0.156863 Aug 17 23:53:51.539894 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 643/1266] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:51 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:51.717575 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c714aa23-3476-4160-8aff-8e279b136d74 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:51.718186 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c714aa23-3476-4160-8aff-8e279b136d74 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:51.725111 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c714aa23-3476-4160-8aff-8e279b136d74 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:51.725591 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c714aa23-3476-4160-8aff-8e279b136d74 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:51.726022 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c714aa23-3476-4160-8aff-8e279b136d74 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:51.726703 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c714aa23-3476-4160-8aff-8e279b136d74 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:51.727155 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c714aa23-3476-4160-8aff-8e279b136d74 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:51.727581 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c714aa23-3476-4160-8aff-8e279b136d74 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:51.856794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c714aa23-3476-4160-8aff-8e279b136d74 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:51.864407 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c714aa23-3476-4160-8aff-8e279b136d74 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217" status: 200 len: 1514 microversion: 2.1 time: 0.150598 Aug 17 23:53:51.865125 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 624/1267] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:51 2022] GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:52.560592 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-15d0a64e-64cf-46cb-acf7-ed48f0ace31f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:52.561307 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-15d0a64e-64cf-46cb-acf7-ed48f0ace31f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:52.567685 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-15d0a64e-64cf-46cb-acf7-ed48f0ace31f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:52.568207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-15d0a64e-64cf-46cb-acf7-ed48f0ace31f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:52.568645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-15d0a64e-64cf-46cb-acf7-ed48f0ace31f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:52.569345 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-15d0a64e-64cf-46cb-acf7-ed48f0ace31f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:52.569800 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-15d0a64e-64cf-46cb-acf7-ed48f0ace31f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:52.570227 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-15d0a64e-64cf-46cb-acf7-ed48f0ace31f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:52.702062 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-15d0a64e-64cf-46cb-acf7-ed48f0ace31f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:52.711238 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-15d0a64e-64cf-46cb-acf7-ed48f0ace31f tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1267 microversion: 2.1 time: 0.154173 Aug 17 23:53:52.716452 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 644/1268] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:52 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:52.885909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1dd25155-64cf-4cfb-b2c2-2fbfb98bcc2b tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:52.887234 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-1dd25155-64cf-4cfb-b2c2-2fbfb98bcc2b tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:52.894691 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1dd25155-64cf-4cfb-b2c2-2fbfb98bcc2b tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:52.895504 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1dd25155-64cf-4cfb-b2c2-2fbfb98bcc2b tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:52.896150 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1dd25155-64cf-4cfb-b2c2-2fbfb98bcc2b tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:52.897040 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1dd25155-64cf-4cfb-b2c2-2fbfb98bcc2b tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:52.897681 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1dd25155-64cf-4cfb-b2c2-2fbfb98bcc2b tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:52.898137 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1dd25155-64cf-4cfb-b2c2-2fbfb98bcc2b tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:52.961788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-fa79600d-407c-41ee-b78c-7084ac625e15 req-ddc6e1f2-ef49-4354-bf46-20f3fcf45850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1edaabd4-258c-42f9-bafb-0c574cd21217", "name": "network-vif-deleted", "tag": "230d3f9d-0355-42fd-bd7e-6ee6dca9d675"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:53:52.974347 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-fa79600d-407c-41ee-b78c-7084ac625e15 req-ddc6e1f2-ef49-4354-bf46-20f3fcf45850 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:52.974830 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-fa79600d-407c-41ee-b78c-7084ac625e15 req-ddc6e1f2-ef49-4354-bf46-20f3fcf45850 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:52.975258 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-fa79600d-407c-41ee-b78c-7084ac625e15 req-ddc6e1f2-ef49-4354-bf46-20f3fcf45850 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:52.980001 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1dd25155-64cf-4cfb-b2c2-2fbfb98bcc2b tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:52.989531 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-1dd25155-64cf-4cfb-b2c2-2fbfb98bcc2b tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217" status: 200 len: 1472 microversion: 2.1 time: 0.107481 Aug 17 23:53:53.002697 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 625/1269] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:52 2022] GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217 => generated 1472 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:53.003400 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-fa79600d-407c-41ee-b78c-7084ac625e15 req-ddc6e1f2-ef49-4354-bf46-20f3fcf45850 service nova] Creating event network-vif-deleted:230d3f9d-0355-42fd-bd7e-6ee6dca9d675 for instance 1edaabd4-258c-42f9-bafb-0c574cd21217 on hv-cinder-82002 Aug 17 23:53:53.003400 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-fa79600d-407c-41ee-b78c-7084ac625e15 req-ddc6e1f2-ef49-4354-bf46-20f3fcf45850 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041735 Aug 17 23:53:53.003400 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 645/1270] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:53:53.732141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-22470cad-031d-4af5-aba6-fce3f2c1da52 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:53.732751 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-22470cad-031d-4af5-aba6-fce3f2c1da52 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:53.739105 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22470cad-031d-4af5-aba6-fce3f2c1da52 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:53.739582 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22470cad-031d-4af5-aba6-fce3f2c1da52 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:53.740035 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22470cad-031d-4af5-aba6-fce3f2c1da52 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:53.740725 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22470cad-031d-4af5-aba6-fce3f2c1da52 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:53.741174 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22470cad-031d-4af5-aba6-fce3f2c1da52 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:53.741595 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-22470cad-031d-4af5-aba6-fce3f2c1da52 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:53.869494 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-22470cad-031d-4af5-aba6-fce3f2c1da52 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:53.877453 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-22470cad-031d-4af5-aba6-fce3f2c1da52 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1267 microversion: 2.1 time: 0.149230 Aug 17 23:53:53.878013 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 626/1271] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:53 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:54.010868 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-548d8e27-76b5-4f06-84b3-99e1a81bf147 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:54.011482 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-548d8e27-76b5-4f06-84b3-99e1a81bf147 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 1edaabd4-258c-42f9-bafb-0c574cd21217] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:54.018084 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-548d8e27-76b5-4f06-84b3-99e1a81bf147 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:54.018554 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-548d8e27-76b5-4f06-84b3-99e1a81bf147 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:54.018985 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-548d8e27-76b5-4f06-84b3-99e1a81bf147 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:54.019662 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-548d8e27-76b5-4f06-84b3-99e1a81bf147 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:54.020143 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-548d8e27-76b5-4f06-84b3-99e1a81bf147 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:54.020564 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-548d8e27-76b5-4f06-84b3-99e1a81bf147 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:54.034162 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-548d8e27-76b5-4f06-84b3-99e1a81bf147 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] HTTP exception thrown: Instance 1edaabd4-258c-42f9-bafb-0c574cd21217 could not be found. Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-548d8e27-76b5-4f06-84b3-99e1a81bf147 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Request method failure captured: Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217 HTTP/1.1 Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X86QblTMGu2YP4Fxo4SxKAi4pajrj3J2tbCF0Dwvm-ijx923isPEyJFgk1lduQU97vQ9ojnd202B_NRCwIazHjIj1MmeiUeVB5tbZhHh8gU5A3WCaf4ltJlTQoEFNgmsYmyyBMJ_GYMfWTfqS-GtuDsZLGMMQjqaqfh2tR7wegXc-M Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: 190eae26a0d5487882d1c59c337f0db4 Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1475852364 Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:53:54.035797 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:53:54.037429 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/190eae26a0d5487882d1c59c337f0db4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_190eae26a0d5487882d1c59c337f0db4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/190eae26a0d5487882d1c59c337f0db4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/190eae26a0d5487882d1c59c337f0db4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:53:54.037429 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-VolumesSnapshotTestJSON-1475852364 Aug 17 23:53:54.037429 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: 190eae26a0d5487882d1c59c337f0db4 Aug 17 23:53:54.037429 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1475852364 Aug 17 23:53:54.037429 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-VolumesSnapshotTestJSON-1475852364-project Aug 17 23:53:54.037429 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:53:54.037429 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:53:54.037429 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 64fdf46f185c48558ad1a637898745a9 Aug 17 23:53:54.037429 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-VolumesSnapshotTestJSON-1475852364-project Aug 17 23:53:54.037429 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:53:54.037429 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance 1edaabd4-258c-42f9-bafb-0c574cd21217 could not be found. Aug 17 23:53:54.037429 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': '1edaabd4-258c-42f9-bafb-0c574cd21217'} Aug 17 23:53:54.038506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:53:54.038506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:53:54.038506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:53:54.038506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:53:54.038506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:53:54.038506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:53:54.038506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:53:54.038506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:53:54.038506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:53:54.038506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:53:54.038506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1edaabd4-258c-42f9-bafb-0c574cd21217 could not be found. Aug 17 23:53:54.038506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:53:54.038506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:53:54.038506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:53:54.038506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:53:54.038506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:53:54.038506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:53:54.038506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:53:54.038506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:53:54.038506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:53:54.040571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:53:54.040571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:53:54.040571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:53:54.040571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:53:54.040571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:53:54.040571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:53:54.040571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:53:54.040571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1edaabd4-258c-42f9-bafb-0c574cd21217 could not be found. Aug 17 23:53:54.040571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:53:54.040571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:53:54.040571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:53:54.040571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:53:54.040571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:53:54.040571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:53:54.040571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:53:54.040571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:53:54.040571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1edaabd4-258c-42f9-bafb-0c574cd21217 could not be found. Aug 17 23:53:54.040571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:53:54.042531 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-548d8e27-76b5-4f06-84b3-99e1a81bf147 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Returning 404 to user: Instance 1edaabd4-258c-42f9-bafb-0c574cd21217 could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:53:54.042531 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-548d8e27-76b5-4f06-84b3-99e1a81bf147 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217" status: 404 len: 111 microversion: 2.1 time: 0.030655 Aug 17 23:53:54.042531 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 646/1272] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:54 2022] GET /compute/v2.1/servers/1edaabd4-258c-42f9-bafb-0c574cd21217 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:53:54.199942 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-99002c0e-d129-4dd0-ae9e-f52516470749 req-482ee9bf-b2a4-4abe-947c-22db972c3906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc", "name": "network-vif-plugged", "status": "completed", "tag": "2319edc7-eacd-41d6-8e52-fbb209f31acd"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:53:54.211077 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-99002c0e-d129-4dd0-ae9e-f52516470749 req-482ee9bf-b2a4-4abe-947c-22db972c3906 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:54.211719 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-99002c0e-d129-4dd0-ae9e-f52516470749 req-482ee9bf-b2a4-4abe-947c-22db972c3906 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:54.212396 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-99002c0e-d129-4dd0-ae9e-f52516470749 req-482ee9bf-b2a4-4abe-947c-22db972c3906 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:54.229756 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-99002c0e-d129-4dd0-ae9e-f52516470749 req-482ee9bf-b2a4-4abe-947c-22db972c3906 service nova] Creating event network-vif-plugged:2319edc7-eacd-41d6-8e52-fbb209f31acd for instance 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc on hv-cinder-82002 Aug 17 23:53:54.235127 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-99002c0e-d129-4dd0-ae9e-f52516470749 req-482ee9bf-b2a4-4abe-947c-22db972c3906 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038770 Aug 17 23:53:54.236392 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 627/1273] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:53:54.898077 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-555cdcc9-c318-4148-ba46-2e02b44628aa tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:54.898619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-555cdcc9-c318-4148-ba46-2e02b44628aa tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:54.904732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-555cdcc9-c318-4148-ba46-2e02b44628aa tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:54.905217 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-555cdcc9-c318-4148-ba46-2e02b44628aa tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:54.905686 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-555cdcc9-c318-4148-ba46-2e02b44628aa tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:54.906370 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-555cdcc9-c318-4148-ba46-2e02b44628aa tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:54.906825 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-555cdcc9-c318-4148-ba46-2e02b44628aa tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:54.907250 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-555cdcc9-c318-4148-ba46-2e02b44628aa tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:55.043761 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-555cdcc9-c318-4148-ba46-2e02b44628aa tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:55.051776 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-555cdcc9-c318-4148-ba46-2e02b44628aa tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1267 microversion: 2.1 time: 0.157650 Aug 17 23:53:55.052354 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 647/1274] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:54 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:56.073202 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1b772e37-7837-44a4-bfa5-426bdbdf4cc3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:56.073903 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-1b772e37-7837-44a4-bfa5-426bdbdf4cc3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:56.080536 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1b772e37-7837-44a4-bfa5-426bdbdf4cc3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:56.081011 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1b772e37-7837-44a4-bfa5-426bdbdf4cc3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:56.081446 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1b772e37-7837-44a4-bfa5-426bdbdf4cc3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:56.082133 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1b772e37-7837-44a4-bfa5-426bdbdf4cc3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:56.082583 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1b772e37-7837-44a4-bfa5-426bdbdf4cc3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:56.083003 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1b772e37-7837-44a4-bfa5-426bdbdf4cc3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:56.220676 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1b772e37-7837-44a4-bfa5-426bdbdf4cc3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:56.224215 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:53:56.229623 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-1b772e37-7837-44a4-bfa5-426bdbdf4cc3 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1267 microversion: 2.1 time: 0.161243 Aug 17 23:53:56.230191 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 628/1275] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:56 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:57.250132 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-bc4063f8-fa77-4cd2-bc3d-19859c12c01e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:57.250706 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-bc4063f8-fa77-4cd2-bc3d-19859c12c01e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:57.256853 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bc4063f8-fa77-4cd2-bc3d-19859c12c01e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:57.257330 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bc4063f8-fa77-4cd2-bc3d-19859c12c01e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:57.257760 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bc4063f8-fa77-4cd2-bc3d-19859c12c01e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:57.258443 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bc4063f8-fa77-4cd2-bc3d-19859c12c01e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:57.258892 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bc4063f8-fa77-4cd2-bc3d-19859c12c01e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:57.259312 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bc4063f8-fa77-4cd2-bc3d-19859c12c01e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:57.388465 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-bc4063f8-fa77-4cd2-bc3d-19859c12c01e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:57.396344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-bc4063f8-fa77-4cd2-bc3d-19859c12c01e tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1267 microversion: 2.1 time: 0.150095 Aug 17 23:53:57.396901 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 648/1276] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:57 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:58.417483 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a47aeac3-fd65-4a15-9844-a468cffac69d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:58.418104 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a47aeac3-fd65-4a15-9844-a468cffac69d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:58.426339 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a47aeac3-fd65-4a15-9844-a468cffac69d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:58.426817 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a47aeac3-fd65-4a15-9844-a468cffac69d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:58.427253 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a47aeac3-fd65-4a15-9844-a468cffac69d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:58.427942 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a47aeac3-fd65-4a15-9844-a468cffac69d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:58.428488 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a47aeac3-fd65-4a15-9844-a468cffac69d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:58.428914 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a47aeac3-fd65-4a15-9844-a468cffac69d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:58.559518 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a47aeac3-fd65-4a15-9844-a468cffac69d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:58.567115 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a47aeac3-fd65-4a15-9844-a468cffac69d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1267 microversion: 2.1 time: 0.153683 Aug 17 23:53:58.567730 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 629/1277] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:58 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:53:59.109591 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-87f5f6fb-cc5f-4f57-855a-d688eeacf907 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:59.110115 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-87f5f6fb-cc5f-4f57-855a-d688eeacf907 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:59.116685 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87f5f6fb-cc5f-4f57-855a-d688eeacf907 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:59.117161 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87f5f6fb-cc5f-4f57-855a-d688eeacf907 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:59.117601 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87f5f6fb-cc5f-4f57-855a-d688eeacf907 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:59.118278 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87f5f6fb-cc5f-4f57-855a-d688eeacf907 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:59.118725 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87f5f6fb-cc5f-4f57-855a-d688eeacf907 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:59.119140 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-87f5f6fb-cc5f-4f57-855a-d688eeacf907 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:59.141367 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-87f5f6fb-cc5f-4f57-855a-d688eeacf907 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/ips" status: 200 len: 146 microversion: 2.1 time: 0.035675 Aug 17 23:53:59.141919 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 649/1278] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Aug 17 23:53:59 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:53:59.587663 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-95628812-373e-40db-b847-9c172d68d5f4 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:53:59.588238 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-95628812-373e-40db-b847-9c172d68d5f4 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:53:59.594587 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-95628812-373e-40db-b847-9c172d68d5f4 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:59.595085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-95628812-373e-40db-b847-9c172d68d5f4 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:59.595593 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-95628812-373e-40db-b847-9c172d68d5f4 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:59.596323 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-95628812-373e-40db-b847-9c172d68d5f4 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:53:59.596789 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-95628812-373e-40db-b847-9c172d68d5f4 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:53:59.597222 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-95628812-373e-40db-b847-9c172d68d5f4 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:53:59.728041 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-95628812-373e-40db-b847-9c172d68d5f4 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:53:59.735572 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-95628812-373e-40db-b847-9c172d68d5f4 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1267 microversion: 2.1 time: 0.152002 Aug 17 23:53:59.737069 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 630/1279] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:53:59 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:00.756995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-c4c67536-ba98-49ce-a531-94462b8a2eb8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:00.757607 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-c4c67536-ba98-49ce-a531-94462b8a2eb8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:00.763920 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c4c67536-ba98-49ce-a531-94462b8a2eb8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:00.764431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c4c67536-ba98-49ce-a531-94462b8a2eb8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:00.764873 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c4c67536-ba98-49ce-a531-94462b8a2eb8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:00.765580 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c4c67536-ba98-49ce-a531-94462b8a2eb8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:00.766033 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c4c67536-ba98-49ce-a531-94462b8a2eb8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:00.766460 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-c4c67536-ba98-49ce-a531-94462b8a2eb8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:00.909335 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-c4c67536-ba98-49ce-a531-94462b8a2eb8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:00.916960 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-c4c67536-ba98-49ce-a531-94462b8a2eb8 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1267 microversion: 2.1 time: 0.163762 Aug 17 23:54:00.917516 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 650/1280] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:00 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:01.515426 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3d28d85f-9861-4e47-aff6-685ca4581612 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42494fae-5dc0-42dc-b94e-50cced21d147"}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:54:01.518478 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3d28d85f-9861-4e47-aff6-685ca4581612 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:01.524759 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3d28d85f-9861-4e47-aff6-685ca4581612 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:01.525236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3d28d85f-9861-4e47-aff6-685ca4581612 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:01.525667 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3d28d85f-9861-4e47-aff6-685ca4581612 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:01.526377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3d28d85f-9861-4e47-aff6-685ca4581612 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:01.526824 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3d28d85f-9861-4e47-aff6-685ca4581612 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:01.527244 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3d28d85f-9861-4e47-aff6-685ca4581612 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:01.801435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3d28d85f-9861-4e47-aff6-685ca4581612 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "POST /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289779 Aug 17 23:54:01.807109 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 631/1281] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 17 23:54:01 2022] POST /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:54:01.938455 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-ac478e54-57b8-4718-ab80-9bf767cf7313 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:01.939718 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-ac478e54-57b8-4718-ab80-9bf767cf7313 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:01.946117 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac478e54-57b8-4718-ab80-9bf767cf7313 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:01.946594 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac478e54-57b8-4718-ab80-9bf767cf7313 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:01.947024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac478e54-57b8-4718-ab80-9bf767cf7313 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:01.947701 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac478e54-57b8-4718-ab80-9bf767cf7313 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:01.948190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac478e54-57b8-4718-ab80-9bf767cf7313 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:01.948611 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-ac478e54-57b8-4718-ab80-9bf767cf7313 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:02.079145 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-ac478e54-57b8-4718-ab80-9bf767cf7313 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:02.086632 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-ac478e54-57b8-4718-ab80-9bf767cf7313 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1454 microversion: 2.1 time: 0.151988 Aug 17 23:54:02.087201 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 651/1282] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:01 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:02.107618 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-7f13421d-21dc-4678-af5c-f46840e39c18 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:02.108349 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-7f13421d-21dc-4678-af5c-f46840e39c18 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:02.114983 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7f13421d-21dc-4678-af5c-f46840e39c18 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:02.115466 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7f13421d-21dc-4678-af5c-f46840e39c18 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:02.115905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7f13421d-21dc-4678-af5c-f46840e39c18 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:02.116620 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7f13421d-21dc-4678-af5c-f46840e39c18 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:02.117104 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7f13421d-21dc-4678-af5c-f46840e39c18 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:02.117608 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-7f13421d-21dc-4678-af5c-f46840e39c18 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:02.246314 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-7f13421d-21dc-4678-af5c-f46840e39c18 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:02.254292 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-7f13421d-21dc-4678-af5c-f46840e39c18 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1454 microversion: 2.1 time: 0.151323 Aug 17 23:54:02.254859 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 632/1283] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:02 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:04.261283 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-e389ec61-56b6-4070-95ae-add41642b450 req-beb7d318-cfaa-409b-8cf3-1ceb1b25e9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc", "tag": "2319edc7-eacd-41d6-8e52-fbb209f31acd"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:54:04.271149 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-e389ec61-56b6-4070-95ae-add41642b450 req-beb7d318-cfaa-409b-8cf3-1ceb1b25e9d0 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:04.271843 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-e389ec61-56b6-4070-95ae-add41642b450 req-beb7d318-cfaa-409b-8cf3-1ceb1b25e9d0 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:04.272295 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-e389ec61-56b6-4070-95ae-add41642b450 req-beb7d318-cfaa-409b-8cf3-1ceb1b25e9d0 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:04.283161 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-e389ec61-56b6-4070-95ae-add41642b450 req-beb7d318-cfaa-409b-8cf3-1ceb1b25e9d0 service nova] Creating event network-changed:2319edc7-eacd-41d6-8e52-fbb209f31acd for instance 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc on hv-cinder-82002 Aug 17 23:54:04.288163 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-e389ec61-56b6-4070-95ae-add41642b450 req-beb7d318-cfaa-409b-8cf3-1ceb1b25e9d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030606 Aug 17 23:54:04.288737 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 652/1284] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:54:07.033731 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e25bce5b-8d6c-4330-b613-9e906f20f0c3 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-596652026", "imageRef": "a3cf81e5-e973-4c08-b1da-4e8f104b52a1", "flavorRef": "452", "networks": [{"uuid": "8b7f4c6b-06be-41ff-8977-5587b626ca6e"}]}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:54:07.087261 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.network.neutron [None req-e25bce5b-8d6c-4330-b613-9e906f20f0c3 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] validate_networks() for [('8b7f4c6b-06be-41ff-8977-5587b626ca6e', None, None, None, None, None)] {{(pid=131395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 23:54:07.445915 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-e25bce5b-8d6c-4330-b613-9e906f20f0c3 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Flavor limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 23:54:07.446378 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-e25bce5b-8d6c-4330-b613-9e906f20f0c3 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Image limits 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 23:54:07.446861 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-e25bce5b-8d6c-4330-b613-9e906f20f0c3 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Flavor pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 23:54:07.447278 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-e25bce5b-8d6c-4330-b613-9e906f20f0c3 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Image pref 0:0:0 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 23:54:07.447757 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.virt.hardware [None req-e25bce5b-8d6c-4330-b613-9e906f20f0c3 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 23:54:07.449795 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=38 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:54:07.458871 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e25bce5b-8d6c-4330-b613-9e906f20f0c3 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:07.459392 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e25bce5b-8d6c-4330-b613-9e906f20f0c3 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:07.459832 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e25bce5b-8d6c-4330-b613-9e906f20f0c3 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:07.460590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e25bce5b-8d6c-4330-b613-9e906f20f0c3 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:07.461051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e25bce5b-8d6c-4330-b613-9e906f20f0c3 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:07.461478 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e25bce5b-8d6c-4330-b613-9e906f20f0c3 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:07.478161 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-e25bce5b-8d6c-4330-b613-9e906f20f0c3 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Getting quotas for project 190eae26a0d5487882d1c59c337f0db4. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 23:54:07.482143 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.quota [None req-e25bce5b-8d6c-4330-b613-9e906f20f0c3 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Getting quotas for user 64fdf46f185c48558ad1a637898745a9 and project 190eae26a0d5487882d1c59c337f0db4. Resources: {'ram', 'cores', 'instances'} {{(pid=131395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 23:54:07.493147 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e25bce5b-8d6c-4330-b613-9e906f20f0c3 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Going to run 1 instances... {{(pid=131395) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 23:54:07.495375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e25bce5b-8d6c-4330-b613-9e906f20f0c3 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a3cf81e5-e973-4c08-b1da-4e8f104b52a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 23:54:07.539170 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e25bce5b-8d6c-4330-b613-9e906f20f0c3 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509432 Aug 17 23:54:07.540092 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 633/1285] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Aug 17 23:54:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 23:54:07.551789 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-677cc0b0-0ad0-4c70-b682-bbd052a6dd06 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:07.552463 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-677cc0b0-0ad0-4c70-b682-bbd052a6dd06 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:07.554395 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:54:07.607731 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-677cc0b0-0ad0-4c70-b682-bbd052a6dd06 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:07.614515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-677cc0b0-0ad0-4c70-b682-bbd052a6dd06 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803" status: 200 len: 1218 microversion: 2.1 time: 0.067457 Aug 17 23:54:07.615072 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 653/1286] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:07 2022] GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:08.635221 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e5c78d2c-b5a2-49a7-9aaf-90daf4c25e82 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:08.636488 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e5c78d2c-b5a2-49a7-9aaf-90daf4c25e82 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:08.646164 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e5c78d2c-b5a2-49a7-9aaf-90daf4c25e82 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:08.646653 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e5c78d2c-b5a2-49a7-9aaf-90daf4c25e82 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:08.647116 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e5c78d2c-b5a2-49a7-9aaf-90daf4c25e82 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:08.647847 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e5c78d2c-b5a2-49a7-9aaf-90daf4c25e82 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:08.648326 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e5c78d2c-b5a2-49a7-9aaf-90daf4c25e82 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:08.648746 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e5c78d2c-b5a2-49a7-9aaf-90daf4c25e82 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:08.721005 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e5c78d2c-b5a2-49a7-9aaf-90daf4c25e82 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:08.729288 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e5c78d2c-b5a2-49a7-9aaf-90daf4c25e82 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803" status: 200 len: 1288 microversion: 2.1 time: 0.098398 Aug 17 23:54:08.729851 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 634/1287] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:08 2022] GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803 => generated 1288 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:09.750658 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-0ae62270-03d9-4713-ba6c-f97fc67b74bc tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:09.751267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-0ae62270-03d9-4713-ba6c-f97fc67b74bc tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:09.759062 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0ae62270-03d9-4713-ba6c-f97fc67b74bc tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:09.759550 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0ae62270-03d9-4713-ba6c-f97fc67b74bc tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:09.760000 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0ae62270-03d9-4713-ba6c-f97fc67b74bc tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:09.760695 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0ae62270-03d9-4713-ba6c-f97fc67b74bc tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:09.761145 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0ae62270-03d9-4713-ba6c-f97fc67b74bc tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:09.761566 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0ae62270-03d9-4713-ba6c-f97fc67b74bc tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:09.832731 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-b23e70f3-9ab7-4ef2-8f43-aa405d006c6e req-6c3dd66d-398f-471d-a482-1fdc1e0fbaf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85409f9d-3281-4813-8f51-2eedaa92e803", "tag": "a72b4917-4083-44b3-bc5c-a9f5917243a5"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:54:09.843591 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-b23e70f3-9ab7-4ef2-8f43-aa405d006c6e req-6c3dd66d-398f-471d-a482-1fdc1e0fbaf6 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:09.844534 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-b23e70f3-9ab7-4ef2-8f43-aa405d006c6e req-6c3dd66d-398f-471d-a482-1fdc1e0fbaf6 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:09.845188 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-b23e70f3-9ab7-4ef2-8f43-aa405d006c6e req-6c3dd66d-398f-471d-a482-1fdc1e0fbaf6 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:09.857852 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-b23e70f3-9ab7-4ef2-8f43-aa405d006c6e req-6c3dd66d-398f-471d-a482-1fdc1e0fbaf6 service nova] Creating event network-changed:a72b4917-4083-44b3-bc5c-a9f5917243a5 for instance 85409f9d-3281-4813-8f51-2eedaa92e803 on hv-cinder-82002 Aug 17 23:54:09.864066 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-b23e70f3-9ab7-4ef2-8f43-aa405d006c6e req-6c3dd66d-398f-471d-a482-1fdc1e0fbaf6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035035 Aug 17 23:54:09.864663 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 635/1288] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:54:09.903571 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0ae62270-03d9-4713-ba6c-f97fc67b74bc tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:09.911185 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-0ae62270-03d9-4713-ba6c-f97fc67b74bc tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803" status: 200 len: 1318 microversion: 2.1 time: 0.164397 Aug 17 23:54:09.911761 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 654/1289] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:09 2022] GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:10.933070 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-d42873c8-0ea4-461e-8fb0-0807802e9b49 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:10.933766 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-d42873c8-0ea4-461e-8fb0-0807802e9b49 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:10.940337 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d42873c8-0ea4-461e-8fb0-0807802e9b49 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:10.940815 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d42873c8-0ea4-461e-8fb0-0807802e9b49 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:10.941252 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d42873c8-0ea4-461e-8fb0-0807802e9b49 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:10.941933 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d42873c8-0ea4-461e-8fb0-0807802e9b49 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:10.942387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d42873c8-0ea4-461e-8fb0-0807802e9b49 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:10.942807 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-d42873c8-0ea4-461e-8fb0-0807802e9b49 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:11.078677 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-d42873c8-0ea4-461e-8fb0-0807802e9b49 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:11.086707 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-d42873c8-0ea4-461e-8fb0-0807802e9b49 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803" status: 200 len: 1318 microversion: 2.1 time: 0.158353 Aug 17 23:54:11.087268 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 636/1290] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:10 2022] GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:12.106618 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-6e4c4bfa-d502-4f0c-bc2b-131744716318 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:12.107232 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-6e4c4bfa-d502-4f0c-bc2b-131744716318 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:12.113758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6e4c4bfa-d502-4f0c-bc2b-131744716318 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:12.114237 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6e4c4bfa-d502-4f0c-bc2b-131744716318 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:12.114677 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6e4c4bfa-d502-4f0c-bc2b-131744716318 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:12.115360 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6e4c4bfa-d502-4f0c-bc2b-131744716318 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:12.115815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6e4c4bfa-d502-4f0c-bc2b-131744716318 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:12.116263 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6e4c4bfa-d502-4f0c-bc2b-131744716318 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:12.243293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-6e4c4bfa-d502-4f0c-bc2b-131744716318 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:12.250655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-6e4c4bfa-d502-4f0c-bc2b-131744716318 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803" status: 200 len: 1318 microversion: 2.1 time: 0.147961 Aug 17 23:54:12.251271 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 655/1291] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:12 2022] GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:13.270696 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-daaa41a9-83fe-4ea5-8f3f-0628e4203db9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:13.271250 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-daaa41a9-83fe-4ea5-8f3f-0628e4203db9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:13.277717 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-daaa41a9-83fe-4ea5-8f3f-0628e4203db9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:13.278194 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-daaa41a9-83fe-4ea5-8f3f-0628e4203db9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:13.278630 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-daaa41a9-83fe-4ea5-8f3f-0628e4203db9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:13.279310 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-daaa41a9-83fe-4ea5-8f3f-0628e4203db9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:13.279836 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-daaa41a9-83fe-4ea5-8f3f-0628e4203db9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:13.280298 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-daaa41a9-83fe-4ea5-8f3f-0628e4203db9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:13.412604 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-daaa41a9-83fe-4ea5-8f3f-0628e4203db9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:13.420253 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-daaa41a9-83fe-4ea5-8f3f-0628e4203db9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803" status: 200 len: 1318 microversion: 2.1 time: 0.153483 Aug 17 23:54:13.420816 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 637/1292] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:13 2022] GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:14.441283 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-75c7d954-6d15-4b25-bc41-d7949d62d6cd tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:14.441901 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-75c7d954-6d15-4b25-bc41-d7949d62d6cd tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:14.448098 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-75c7d954-6d15-4b25-bc41-d7949d62d6cd tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:14.448597 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-75c7d954-6d15-4b25-bc41-d7949d62d6cd tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:14.449024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-75c7d954-6d15-4b25-bc41-d7949d62d6cd tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:14.449725 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-75c7d954-6d15-4b25-bc41-d7949d62d6cd tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:14.450181 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-75c7d954-6d15-4b25-bc41-d7949d62d6cd tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:14.450605 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-75c7d954-6d15-4b25-bc41-d7949d62d6cd tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:14.586463 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-75c7d954-6d15-4b25-bc41-d7949d62d6cd tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:14.595237 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-75c7d954-6d15-4b25-bc41-d7949d62d6cd tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803" status: 200 len: 1318 microversion: 2.1 time: 0.157669 Aug 17 23:54:14.596069 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 656/1293] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:14 2022] GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:14.612821 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b96c39ea-475e-480e-91d6-1aedd521a682 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:14.615061 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b96c39ea-475e-480e-91d6-1aedd521a682 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:14.621209 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b96c39ea-475e-480e-91d6-1aedd521a682 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:14.621695 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b96c39ea-475e-480e-91d6-1aedd521a682 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:14.622158 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b96c39ea-475e-480e-91d6-1aedd521a682 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:14.622836 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b96c39ea-475e-480e-91d6-1aedd521a682 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:14.623290 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b96c39ea-475e-480e-91d6-1aedd521a682 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:14.623721 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b96c39ea-475e-480e-91d6-1aedd521a682 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:14.653496 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b96c39ea-475e-480e-91d6-1aedd521a682 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Aug 17 23:54:14.654066 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 638/1294] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:54:14 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:54:14.665068 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-069c3a22-ec3c-491c-b74f-92a0f2b173ed tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:14.665565 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-069c3a22-ec3c-491c-b74f-92a0f2b173ed tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:14.671401 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-069c3a22-ec3c-491c-b74f-92a0f2b173ed tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:14.671888 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-069c3a22-ec3c-491c-b74f-92a0f2b173ed tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:14.672355 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-069c3a22-ec3c-491c-b74f-92a0f2b173ed tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:14.673051 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-069c3a22-ec3c-491c-b74f-92a0f2b173ed tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:14.673537 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-069c3a22-ec3c-491c-b74f-92a0f2b173ed tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:14.673967 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-069c3a22-ec3c-491c-b74f-92a0f2b173ed tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:14.702332 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-069c3a22-ec3c-491c-b74f-92a0f2b173ed tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments/42494fae-5dc0-42dc-b94e-50cced21d147" status: 200 len: 194 microversion: 2.1 time: 0.041403 Aug 17 23:54:14.702910 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 657/1295] 10.222.0.26 () {58 vars in 1413 bytes} [Wed Aug 17 23:54:14 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments/42494fae-5dc0-42dc-b94e-50cced21d147 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:54:15.617928 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-61a64ac5-29d5-4ce8-86c9-d59f2df94b9d tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:15.618454 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-61a64ac5-29d5-4ce8-86c9-d59f2df94b9d tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:15.624866 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-61a64ac5-29d5-4ce8-86c9-d59f2df94b9d tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:15.625355 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-61a64ac5-29d5-4ce8-86c9-d59f2df94b9d tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:15.625791 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-61a64ac5-29d5-4ce8-86c9-d59f2df94b9d tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:15.626482 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-61a64ac5-29d5-4ce8-86c9-d59f2df94b9d tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:15.626940 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-61a64ac5-29d5-4ce8-86c9-d59f2df94b9d tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:15.627382 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-61a64ac5-29d5-4ce8-86c9-d59f2df94b9d tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:15.752500 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-61a64ac5-29d5-4ce8-86c9-d59f2df94b9d tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:15.759814 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-61a64ac5-29d5-4ce8-86c9-d59f2df94b9d tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803" status: 200 len: 1318 microversion: 2.1 time: 0.145918 Aug 17 23:54:15.760413 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 639/1296] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:15 2022] GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:16.028644 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b3a78c64-b646-44ba-b180-a0ae0d65eab3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c6cdbcd-4113-4e61-88ec-d80a6b0451e6"}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:54:16.031116 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b3a78c64-b646-44ba-b180-a0ae0d65eab3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:16.038191 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b3a78c64-b646-44ba-b180-a0ae0d65eab3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:16.038673 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b3a78c64-b646-44ba-b180-a0ae0d65eab3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:16.039111 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b3a78c64-b646-44ba-b180-a0ae0d65eab3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:16.040087 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b3a78c64-b646-44ba-b180-a0ae0d65eab3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:16.040543 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b3a78c64-b646-44ba-b180-a0ae0d65eab3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:16.040970 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b3a78c64-b646-44ba-b180-a0ae0d65eab3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:16.331700 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b3a78c64-b646-44ba-b180-a0ae0d65eab3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "POST /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306791 Aug 17 23:54:16.336005 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 658/1297] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 17 23:54:16 2022] POST /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:54:16.780957 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a777aecb-7769-4c3d-8e0a-22d43cd8ac8e tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:16.781573 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a777aecb-7769-4c3d-8e0a-22d43cd8ac8e tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:16.787836 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a777aecb-7769-4c3d-8e0a-22d43cd8ac8e tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:16.788368 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a777aecb-7769-4c3d-8e0a-22d43cd8ac8e tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:16.788836 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a777aecb-7769-4c3d-8e0a-22d43cd8ac8e tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:16.789788 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a777aecb-7769-4c3d-8e0a-22d43cd8ac8e tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:16.790251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a777aecb-7769-4c3d-8e0a-22d43cd8ac8e tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:16.790673 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a777aecb-7769-4c3d-8e0a-22d43cd8ac8e tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:16.810623 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-fbefa8a2-e0b5-461c-b3ee-fce9bb0c521b req-13bc7173-8653-4a7c-ab5e-cb38ad115e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85409f9d-3281-4813-8f51-2eedaa92e803", "name": "network-vif-plugged", "status": "completed", "tag": "a72b4917-4083-44b3-bc5c-a9f5917243a5"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:54:16.823065 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-fbefa8a2-e0b5-461c-b3ee-fce9bb0c521b req-13bc7173-8653-4a7c-ab5e-cb38ad115e19 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:16.823677 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-fbefa8a2-e0b5-461c-b3ee-fce9bb0c521b req-13bc7173-8653-4a7c-ab5e-cb38ad115e19 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:16.824243 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-fbefa8a2-e0b5-461c-b3ee-fce9bb0c521b req-13bc7173-8653-4a7c-ab5e-cb38ad115e19 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:16.835857 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-fbefa8a2-e0b5-461c-b3ee-fce9bb0c521b req-13bc7173-8653-4a7c-ab5e-cb38ad115e19 service nova] Creating event network-vif-plugged:a72b4917-4083-44b3-bc5c-a9f5917243a5 for instance 85409f9d-3281-4813-8f51-2eedaa92e803 on hv-cinder-82002 Aug 17 23:54:16.841457 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-fbefa8a2-e0b5-461c-b3ee-fce9bb0c521b req-13bc7173-8653-4a7c-ab5e-cb38ad115e19 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034415 Aug 17 23:54:16.841990 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 659/1298] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:54:16.926443 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a777aecb-7769-4c3d-8e0a-22d43cd8ac8e tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:16.933907 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a777aecb-7769-4c3d-8e0a-22d43cd8ac8e tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803" status: 200 len: 1318 microversion: 2.1 time: 0.156863 Aug 17 23:54:16.934491 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 640/1299] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:16 2022] GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:17.952480 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell0:SELECT=2 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:54:17.956565 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-3bbc18aa-fe42-4e0b-a6bb-f6bd2598dd4a tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:17.957273 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-3bbc18aa-fe42-4e0b-a6bb-f6bd2598dd4a tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:17.963634 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3bbc18aa-fe42-4e0b-a6bb-f6bd2598dd4a tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:17.964153 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3bbc18aa-fe42-4e0b-a6bb-f6bd2598dd4a tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:17.964591 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3bbc18aa-fe42-4e0b-a6bb-f6bd2598dd4a tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:17.965276 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3bbc18aa-fe42-4e0b-a6bb-f6bd2598dd4a tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:17.965731 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3bbc18aa-fe42-4e0b-a6bb-f6bd2598dd4a tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:17.966160 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3bbc18aa-fe42-4e0b-a6bb-f6bd2598dd4a tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:18.096991 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-3bbc18aa-fe42-4e0b-a6bb-f6bd2598dd4a tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:18.104396 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-3bbc18aa-fe42-4e0b-a6bb-f6bd2598dd4a tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803" status: 200 len: 1318 microversion: 2.1 time: 0.153354 Aug 17 23:54:18.104956 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 660/1300] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:17 2022] GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:19.125382 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c9924d95-64d9-4397-a912-a9e4862f95fb tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:19.125999 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c9924d95-64d9-4397-a912-a9e4862f95fb tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:19.128485 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:54:19.129241 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell0:SELECT=6 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:54:19.135334 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c9924d95-64d9-4397-a912-a9e4862f95fb tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:19.135825 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c9924d95-64d9-4397-a912-a9e4862f95fb tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:19.136308 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c9924d95-64d9-4397-a912-a9e4862f95fb tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:19.137011 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c9924d95-64d9-4397-a912-a9e4862f95fb tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:19.137470 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c9924d95-64d9-4397-a912-a9e4862f95fb tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:19.137901 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c9924d95-64d9-4397-a912-a9e4862f95fb tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:19.268960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c9924d95-64d9-4397-a912-a9e4862f95fb tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:19.276435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c9924d95-64d9-4397-a912-a9e4862f95fb tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803" status: 200 len: 1508 microversion: 2.1 time: 0.154953 Aug 17 23:54:19.277005 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 641/1301] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:19 2022] GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:19.296713 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-bb7160e6-5bf3-4569-87ba-91d5cc354082 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1d0b201-3607-4b5a-a98b-6fb4759a23cc", "device": "/dev/sdb"}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:54:19.299517 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-bb7160e6-5bf3-4569-87ba-91d5cc354082 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:19.305788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb7160e6-5bf3-4569-87ba-91d5cc354082 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:19.306262 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb7160e6-5bf3-4569-87ba-91d5cc354082 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:19.306696 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb7160e6-5bf3-4569-87ba-91d5cc354082 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:19.307373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb7160e6-5bf3-4569-87ba-91d5cc354082 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:19.307834 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb7160e6-5bf3-4569-87ba-91d5cc354082 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:19.308274 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bb7160e6-5bf3-4569-87ba-91d5cc354082 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:19.672111 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:54:19.693010 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-bb7160e6-5bf3-4569-87ba-91d5cc354082 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "POST /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.399791 Aug 17 23:54:19.693618 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 661/1302] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 17 23:54:19 2022] POST /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803/os-volume_attachments => generated 194 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:54:24.901774 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-6219345b-a554-457e-9724-21146d67e0ae tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:24.904051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-6219345b-a554-457e-9724-21146d67e0ae tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:24.911235 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6219345b-a554-457e-9724-21146d67e0ae tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:24.911656 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6219345b-a554-457e-9724-21146d67e0ae tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:24.912122 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6219345b-a554-457e-9724-21146d67e0ae tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:24.912925 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6219345b-a554-457e-9724-21146d67e0ae tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:24.913389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6219345b-a554-457e-9724-21146d67e0ae tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:24.913815 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6219345b-a554-457e-9724-21146d67e0ae tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:24.943855 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-6219345b-a554-457e-9724-21146d67e0ae tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046106 Aug 17 23:54:24.944440 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 642/1303] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:54:24 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:54:25.087870 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-63060a1f-ae31-46c4-9631-b03624dda1fd tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:25.088505 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-63060a1f-ae31-46c4-9631-b03624dda1fd tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:25.095270 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-63060a1f-ae31-46c4-9631-b03624dda1fd tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:25.095748 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-63060a1f-ae31-46c4-9631-b03624dda1fd tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:25.096209 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-63060a1f-ae31-46c4-9631-b03624dda1fd tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:25.096896 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-63060a1f-ae31-46c4-9631-b03624dda1fd tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:25.097350 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-63060a1f-ae31-46c4-9631-b03624dda1fd tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:25.097800 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-63060a1f-ae31-46c4-9631-b03624dda1fd tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:25.126026 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-63060a1f-ae31-46c4-9631-b03624dda1fd tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments/42494fae-5dc0-42dc-b94e-50cced21d147" status: 200 len: 194 microversion: 2.1 time: 0.042568 Aug 17 23:54:25.127099 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 662/1304] 10.222.0.26 () {58 vars in 1413 bytes} [Wed Aug 17 23:54:25 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments/42494fae-5dc0-42dc-b94e-50cced21d147 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:54:25.137410 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-69a6ce4d-fdf8-4a99-b3fd-d144fd414fee tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:25.137903 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-69a6ce4d-fdf8-4a99-b3fd-d144fd414fee tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:25.144530 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-69a6ce4d-fdf8-4a99-b3fd-d144fd414fee tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:25.145076 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-69a6ce4d-fdf8-4a99-b3fd-d144fd414fee tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:25.145517 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-69a6ce4d-fdf8-4a99-b3fd-d144fd414fee tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:25.146212 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-69a6ce4d-fdf8-4a99-b3fd-d144fd414fee tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:25.146666 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-69a6ce4d-fdf8-4a99-b3fd-d144fd414fee tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:25.147088 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-69a6ce4d-fdf8-4a99-b3fd-d144fd414fee tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:25.225314 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.objects.instance [None req-69a6ce4d-fdf8-4a99-b3fd-d144fd414fee tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lazy-loading 'services' on Instance uuid 7eafae50-1872-417f-8a14-b794355d89dd {{(pid=131395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:54:25.294577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-69a6ce4d-fdf8-4a99-b3fd-d144fd414fee tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments/42494fae-5dc0-42dc-b94e-50cced21d147" status: 202 len: 0 microversion: 2.1 time: 0.160845 Aug 17 23:54:25.295275 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 643/1305] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 17 23:54:25 2022] DELETE /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments/42494fae-5dc0-42dc-b94e-50cced21d147 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:54:33.800477 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-6607a5cf-1082-404e-bada-ed5e3463daa1 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:33.800984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-6607a5cf-1082-404e-bada-ed5e3463daa1 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:33.807413 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6607a5cf-1082-404e-bada-ed5e3463daa1 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:33.807890 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6607a5cf-1082-404e-bada-ed5e3463daa1 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:33.808350 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6607a5cf-1082-404e-bada-ed5e3463daa1 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:33.809027 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6607a5cf-1082-404e-bada-ed5e3463daa1 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:33.809476 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6607a5cf-1082-404e-bada-ed5e3463daa1 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:33.809895 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6607a5cf-1082-404e-bada-ed5e3463daa1 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:33.838330 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-6607a5cf-1082-404e-bada-ed5e3463daa1 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments/4c6cdbcd-4113-4e61-88ec-d80a6b0451e6" status: 200 len: 194 microversion: 2.1 time: 0.041820 Aug 17 23:54:33.838893 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 663/1306] 10.222.0.26 () {58 vars in 1413 bytes} [Wed Aug 17 23:54:33 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments/4c6cdbcd-4113-4e61-88ec-d80a6b0451e6 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:54:33.850559 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e33c5c62-245e-401a-ab29-7350f0d38e85 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:33.851135 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e33c5c62-245e-401a-ab29-7350f0d38e85 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:33.857242 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e33c5c62-245e-401a-ab29-7350f0d38e85 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:33.857720 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e33c5c62-245e-401a-ab29-7350f0d38e85 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:33.858150 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e33c5c62-245e-401a-ab29-7350f0d38e85 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:33.858828 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e33c5c62-245e-401a-ab29-7350f0d38e85 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:33.859278 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e33c5c62-245e-401a-ab29-7350f0d38e85 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:33.859700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e33c5c62-245e-401a-ab29-7350f0d38e85 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:33.862260 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:54:33.939278 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.objects.instance [None req-e33c5c62-245e-401a-ab29-7350f0d38e85 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lazy-loading 'services' on Instance uuid 7eafae50-1872-417f-8a14-b794355d89dd {{(pid=131395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:54:34.008720 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e33c5c62-245e-401a-ab29-7350f0d38e85 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments/4c6cdbcd-4113-4e61-88ec-d80a6b0451e6" status: 202 len: 0 microversion: 2.1 time: 0.163085 Aug 17 23:54:34.009234 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 644/1307] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 17 23:54:33 2022] DELETE /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments/4c6cdbcd-4113-4e61-88ec-d80a6b0451e6 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:54:39.398299 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-71c5311d-e0fa-47e9-858b-abb00b13cbce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:39.400594 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-71c5311d-e0fa-47e9-858b-abb00b13cbce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:39.403040 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=24 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:54:39.408858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-71c5311d-e0fa-47e9-858b-abb00b13cbce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:39.409342 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-71c5311d-e0fa-47e9-858b-abb00b13cbce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:39.409786 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-71c5311d-e0fa-47e9-858b-abb00b13cbce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:39.410477 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-71c5311d-e0fa-47e9-858b-abb00b13cbce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:39.410940 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-71c5311d-e0fa-47e9-858b-abb00b13cbce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:39.411434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-71c5311d-e0fa-47e9-858b-abb00b13cbce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:39.441305 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-71c5311d-e0fa-47e9-858b-abb00b13cbce tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046888 Aug 17 23:54:39.441858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 664/1308] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:54:39 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 23:54:39.552915 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-6c0a0c23-9536-45ad-8730-f58056f46cd3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:39.555159 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-6c0a0c23-9536-45ad-8730-f58056f46cd3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:39.557597 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:54:39.562909 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6c0a0c23-9536-45ad-8730-f58056f46cd3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:39.563390 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6c0a0c23-9536-45ad-8730-f58056f46cd3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:39.563866 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6c0a0c23-9536-45ad-8730-f58056f46cd3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:39.564577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6c0a0c23-9536-45ad-8730-f58056f46cd3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:39.565035 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6c0a0c23-9536-45ad-8730-f58056f46cd3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:39.565459 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6c0a0c23-9536-45ad-8730-f58056f46cd3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:39.593920 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-6c0a0c23-9536-45ad-8730-f58056f46cd3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045343 Aug 17 23:54:39.594467 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 645/1309] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:54:39 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 23:54:39.654776 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1a851480-d9f4-4033-859b-ce53fa07971f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:39.655280 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1a851480-d9f4-4033-859b-ce53fa07971f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:39.661847 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1a851480-d9f4-4033-859b-ce53fa07971f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:39.662331 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1a851480-d9f4-4033-859b-ce53fa07971f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:39.662772 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1a851480-d9f4-4033-859b-ce53fa07971f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:39.663458 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1a851480-d9f4-4033-859b-ce53fa07971f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:39.663919 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1a851480-d9f4-4033-859b-ce53fa07971f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:39.664371 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1a851480-d9f4-4033-859b-ce53fa07971f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:39.688288 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1a851480-d9f4-4033-859b-ce53fa07971f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Going to try to terminate instance {{(pid=131394) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:54:39.762597 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1a851480-d9f4-4033-859b-ce53fa07971f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 204 len: 0 microversion: 2.1 time: 0.111478 Aug 17 23:54:39.763607 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 665/1310] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:54:39 2022] DELETE /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 23:54:39.773289 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ce76cf8f-5838-4397-9680-4bcfdb76d8a3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:39.773897 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ce76cf8f-5838-4397-9680-4bcfdb76d8a3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:39.779668 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ce76cf8f-5838-4397-9680-4bcfdb76d8a3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:39.780212 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ce76cf8f-5838-4397-9680-4bcfdb76d8a3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:39.780650 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ce76cf8f-5838-4397-9680-4bcfdb76d8a3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:39.781334 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ce76cf8f-5838-4397-9680-4bcfdb76d8a3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:39.781783 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ce76cf8f-5838-4397-9680-4bcfdb76d8a3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:39.782204 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ce76cf8f-5838-4397-9680-4bcfdb76d8a3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:39.909479 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-ce76cf8f-5838-4397-9680-4bcfdb76d8a3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:39.917246 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ce76cf8f-5838-4397-9680-4bcfdb76d8a3 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 200 len: 1673 microversion: 2.1 time: 0.148947 Aug 17 23:54:39.917830 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 646/1311] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:39 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:40.938742 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-651342f2-1c0f-403a-a525-60dfb5173711 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:40.939437 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-651342f2-1c0f-403a-a525-60dfb5173711 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:40.946519 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-651342f2-1c0f-403a-a525-60dfb5173711 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:40.946775 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-651342f2-1c0f-403a-a525-60dfb5173711 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:40.947231 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-651342f2-1c0f-403a-a525-60dfb5173711 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:40.947923 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-651342f2-1c0f-403a-a525-60dfb5173711 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:40.948407 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-651342f2-1c0f-403a-a525-60dfb5173711 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:40.948834 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-651342f2-1c0f-403a-a525-60dfb5173711 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:41.080763 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-651342f2-1c0f-403a-a525-60dfb5173711 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:41.088329 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-651342f2-1c0f-403a-a525-60dfb5173711 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 200 len: 1673 microversion: 2.1 time: 0.153768 Aug 17 23:54:41.088898 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 666/1312] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:40 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:42.110319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b8bc6e61-67c1-40a1-9433-68788fa58786 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:42.111642 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b8bc6e61-67c1-40a1-9433-68788fa58786 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:42.118610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b8bc6e61-67c1-40a1-9433-68788fa58786 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:42.119308 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b8bc6e61-67c1-40a1-9433-68788fa58786 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:42.119759 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b8bc6e61-67c1-40a1-9433-68788fa58786 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:42.120488 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b8bc6e61-67c1-40a1-9433-68788fa58786 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:42.120940 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b8bc6e61-67c1-40a1-9433-68788fa58786 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:42.121357 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b8bc6e61-67c1-40a1-9433-68788fa58786 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:42.255643 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b8bc6e61-67c1-40a1-9433-68788fa58786 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:42.263261 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b8bc6e61-67c1-40a1-9433-68788fa58786 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 200 len: 1673 microversion: 2.1 time: 0.156947 Aug 17 23:54:42.263827 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 647/1313] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:42 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:43.284225 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-95b58351-a27a-49c1-8038-2fb8182f676b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:43.284759 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-95b58351-a27a-49c1-8038-2fb8182f676b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:43.291438 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-95b58351-a27a-49c1-8038-2fb8182f676b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:43.291926 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-95b58351-a27a-49c1-8038-2fb8182f676b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:43.292387 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-95b58351-a27a-49c1-8038-2fb8182f676b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:43.293070 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-95b58351-a27a-49c1-8038-2fb8182f676b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:43.293524 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-95b58351-a27a-49c1-8038-2fb8182f676b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:43.293948 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-95b58351-a27a-49c1-8038-2fb8182f676b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:43.423597 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-95b58351-a27a-49c1-8038-2fb8182f676b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:43.431056 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-95b58351-a27a-49c1-8038-2fb8182f676b tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 200 len: 1673 microversion: 2.1 time: 0.150813 Aug 17 23:54:43.431626 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 667/1314] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:43 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:44.452673 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3c6bbd8f-536f-4c20-b660-de3b1e2b3d3d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:44.453283 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3c6bbd8f-536f-4c20-b660-de3b1e2b3d3d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:44.460496 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3c6bbd8f-536f-4c20-b660-de3b1e2b3d3d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:44.460974 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3c6bbd8f-536f-4c20-b660-de3b1e2b3d3d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:44.461410 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3c6bbd8f-536f-4c20-b660-de3b1e2b3d3d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:44.462096 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3c6bbd8f-536f-4c20-b660-de3b1e2b3d3d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:44.462545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3c6bbd8f-536f-4c20-b660-de3b1e2b3d3d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:44.462960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3c6bbd8f-536f-4c20-b660-de3b1e2b3d3d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:44.591841 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3c6bbd8f-536f-4c20-b660-de3b1e2b3d3d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:44.599282 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3c6bbd8f-536f-4c20-b660-de3b1e2b3d3d tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 200 len: 1673 microversion: 2.1 time: 0.150532 Aug 17 23:54:44.599843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 648/1315] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:44 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:45.620999 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-424ed702-9eca-4b06-9ba5-8c98e25856b0 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:45.621626 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-424ed702-9eca-4b06-9ba5-8c98e25856b0 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:45.628796 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-424ed702-9eca-4b06-9ba5-8c98e25856b0 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:45.629283 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-424ed702-9eca-4b06-9ba5-8c98e25856b0 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:45.629726 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-424ed702-9eca-4b06-9ba5-8c98e25856b0 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:45.630414 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-424ed702-9eca-4b06-9ba5-8c98e25856b0 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:45.630873 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-424ed702-9eca-4b06-9ba5-8c98e25856b0 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:45.631302 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-424ed702-9eca-4b06-9ba5-8c98e25856b0 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:45.756905 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-424ed702-9eca-4b06-9ba5-8c98e25856b0 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:45.764319 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-424ed702-9eca-4b06-9ba5-8c98e25856b0 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 200 len: 1673 microversion: 2.1 time: 0.147187 Aug 17 23:54:45.764886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 668/1316] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:45 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:54:46.785206 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-27e8f008-e0e6-404f-86e6-6c83dde4e90f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:46.785836 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-27e8f008-e0e6-404f-86e6-6c83dde4e90f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:46.792477 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-27e8f008-e0e6-404f-86e6-6c83dde4e90f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:46.792964 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-27e8f008-e0e6-404f-86e6-6c83dde4e90f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:46.793406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-27e8f008-e0e6-404f-86e6-6c83dde4e90f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:46.794096 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-27e8f008-e0e6-404f-86e6-6c83dde4e90f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:46.794553 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-27e8f008-e0e6-404f-86e6-6c83dde4e90f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:46.794979 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-27e8f008-e0e6-404f-86e6-6c83dde4e90f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:47.008338 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-27e8f008-e0e6-404f-86e6-6c83dde4e90f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047293a64a9f4857be1621e77094d367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8246e3b9904e7a8fe4a04269ab0afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:47.015975 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-27e8f008-e0e6-404f-86e6-6c83dde4e90f tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 200 len: 1673 microversion: 2.1 time: 0.234626 Aug 17 23:54:47.016547 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 649/1317] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:46 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 1673 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:47.568952 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-f585d3f9-bc84-4633-9d68-a76fdfbc5baa req-14c41247-6948-419c-b629-83156592af7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eafae50-1872-417f-8a14-b794355d89dd", "name": "network-vif-deleted", "tag": "90c98c9b-0cab-4f98-a069-9194887befff"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:54:47.578937 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-f585d3f9-bc84-4633-9d68-a76fdfbc5baa req-14c41247-6948-419c-b629-83156592af7a service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:47.579944 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-f585d3f9-bc84-4633-9d68-a76fdfbc5baa req-14c41247-6948-419c-b629-83156592af7a service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:47.580396 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-f585d3f9-bc84-4633-9d68-a76fdfbc5baa req-14c41247-6948-419c-b629-83156592af7a service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:47.599154 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-f585d3f9-bc84-4633-9d68-a76fdfbc5baa req-14c41247-6948-419c-b629-83156592af7a service nova] Creating event network-vif-deleted:90c98c9b-0cab-4f98-a069-9194887befff for instance 7eafae50-1872-417f-8a14-b794355d89dd on hv-cinder-82002 Aug 17 23:54:47.606991 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-f585d3f9-bc84-4633-9d68-a76fdfbc5baa req-14c41247-6948-419c-b629-83156592af7a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204972 Aug 17 23:54:47.607906 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 669/1318] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:54:48.037720 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1c0c4276-34c1-456a-b5fc-936742f85fdb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:48.038328 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-1c0c4276-34c1-456a-b5fc-936742f85fdb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:48.046112 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1c0c4276-34c1-456a-b5fc-936742f85fdb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:48.046709 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1c0c4276-34c1-456a-b5fc-936742f85fdb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:48.047337 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1c0c4276-34c1-456a-b5fc-936742f85fdb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:48.048147 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1c0c4276-34c1-456a-b5fc-936742f85fdb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:48.048694 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1c0c4276-34c1-456a-b5fc-936742f85fdb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:48.049155 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1c0c4276-34c1-456a-b5fc-936742f85fdb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:48.063338 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-1c0c4276-34c1-456a-b5fc-936742f85fdb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] HTTP exception thrown: Instance 7eafae50-1872-417f-8a14-b794355d89dd could not be found. Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1c0c4276-34c1-456a-b5fc-936742f85fdb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Request method failure captured: Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd HTTP/1.1 Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X2l-q93st1NTKOWUoSNz4uC5L8oWUfPa3jS8JHpAVCeTW1mGbeFoKODaiXZyYRao1BGhnJ20yZaMNbtrUT7msoYDSB3YlpJgfZfhj_Jan1czDnjdIEQUDgH1r4F_6GAdOobnqXI3ykMvGs8YyfATdG7G4drvLh92zHTdTFIEqzq2dY Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: ec8246e3b9904e7a8fe4a04269ab0afe Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-AttachVolumeTestJSON-51062467 Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:54:48.065590 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:54:48.067109 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ec8246e3b9904e7a8fe4a04269ab0afe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ec8246e3b9904e7a8fe4a04269ab0afe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec8246e3b9904e7a8fe4a04269ab0afe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec8246e3b9904e7a8fe4a04269ab0afe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:54:48.067109 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-AttachVolumeTestJSON-51062467 Aug 17 23:54:48.067109 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: ec8246e3b9904e7a8fe4a04269ab0afe Aug 17 23:54:48.067109 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-AttachVolumeTestJSON-51062467 Aug 17 23:54:48.067109 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-AttachVolumeTestJSON-51062467-project Aug 17 23:54:48.067109 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:54:48.067109 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:54:48.067109 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 047293a64a9f4857be1621e77094d367 Aug 17 23:54:48.067109 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-AttachVolumeTestJSON-51062467-project Aug 17 23:54:48.067109 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:54:48.067109 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance 7eafae50-1872-417f-8a14-b794355d89dd could not be found. Aug 17 23:54:48.067109 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': '7eafae50-1872-417f-8a14-b794355d89dd'} Aug 17 23:54:48.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:54:48.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:54:48.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:54:48.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:54:48.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:54:48.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:54:48.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:54:48.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:54:48.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:54:48.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:54:48.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eafae50-1872-417f-8a14-b794355d89dd could not be found. Aug 17 23:54:48.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:54:48.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:54:48.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:54:48.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:54:48.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:54:48.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:54:48.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:54:48.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:54:48.067921 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:54:48.069377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:54:48.069377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:54:48.069377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:54:48.069377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:54:48.069377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:54:48.069377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:54:48.069377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:54:48.069377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eafae50-1872-417f-8a14-b794355d89dd could not be found. Aug 17 23:54:48.069377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:54:48.069377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:54:48.069377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:54:48.069377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:54:48.069377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:54:48.069377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:54:48.069377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:54:48.069377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:54:48.069377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eafae50-1872-417f-8a14-b794355d89dd could not be found. Aug 17 23:54:48.069377 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:54:48.070602 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1c0c4276-34c1-456a-b5fc-936742f85fdb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Returning 404 to user: Instance 7eafae50-1872-417f-8a14-b794355d89dd could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:54:48.070602 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-1c0c4276-34c1-456a-b5fc-936742f85fdb tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 404 len: 111 microversion: 2.1 time: 0.033407 Aug 17 23:54:48.070602 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 650/1319] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:48 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:54:48.076775 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-a6416ca7-66a6-43dd-acb2-becb46b75df7 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '.version_select at 0x7f85fdb641f0>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:48.098188 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-a6416ca7-66a6-43dd-acb2-becb46b75df7 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-371975336" status: 202 len: 0 microversion: 2.1 time: 0.025823 Aug 17 23:54:48.098766 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 670/1320] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Aug 17 23:54:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-371975336 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:54:48.409166 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-8a972b38-40da-43ef-81b4-eb1f3915d07b tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:48.409587 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-8a972b38-40da-43ef-81b4-eb1f3915d07b tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:48.416447 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a972b38-40da-43ef-81b4-eb1f3915d07b tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:48.416937 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a972b38-40da-43ef-81b4-eb1f3915d07b tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:48.417376 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a972b38-40da-43ef-81b4-eb1f3915d07b tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:48.418280 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a972b38-40da-43ef-81b4-eb1f3915d07b tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:48.418740 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a972b38-40da-43ef-81b4-eb1f3915d07b tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:48.419169 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-8a972b38-40da-43ef-81b4-eb1f3915d07b tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:48.518907 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.objects.instance [None req-8a972b38-40da-43ef-81b4-eb1f3915d07b tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lazy-loading 'services' on Instance uuid 85409f9d-3281-4813-8f51-2eedaa92e803 {{(pid=131395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:54:48.603562 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-8a972b38-40da-43ef-81b4-eb1f3915d07b tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "DELETE /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803/os-volume_attachments/e1d0b201-3607-4b5a-a98b-6fb4759a23cc" status: 202 len: 0 microversion: 2.1 time: 0.198217 Aug 17 23:54:48.604192 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 651/1321] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 17 23:54:48 2022] DELETE /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803/os-volume_attachments/e1d0b201-3607-4b5a-a98b-6fb4759a23cc => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:54:50.785865 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-2776e37d-5fc1-4325-a2bf-38011f0d20d9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:50.786479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-2776e37d-5fc1-4325-a2bf-38011f0d20d9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:50.792742 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2776e37d-5fc1-4325-a2bf-38011f0d20d9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:50.793216 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2776e37d-5fc1-4325-a2bf-38011f0d20d9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:50.793647 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2776e37d-5fc1-4325-a2bf-38011f0d20d9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:50.794325 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2776e37d-5fc1-4325-a2bf-38011f0d20d9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:50.794774 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2776e37d-5fc1-4325-a2bf-38011f0d20d9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:50.795194 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2776e37d-5fc1-4325-a2bf-38011f0d20d9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:50.797771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:54:50.821363 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-2776e37d-5fc1-4325-a2bf-38011f0d20d9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] Going to try to terminate instance {{(pid=131394) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:54:50.896138 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-2776e37d-5fc1-4325-a2bf-38011f0d20d9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "DELETE /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803" status: 204 len: 0 microversion: 2.1 time: 0.115066 Aug 17 23:54:50.896709 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 671/1322] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:54:50 2022] DELETE /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 23:54:50.905821 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-6f58e9a2-383c-4605-9f74-15be7331a184 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:50.906521 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-6f58e9a2-383c-4605-9f74-15be7331a184 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:50.913289 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6f58e9a2-383c-4605-9f74-15be7331a184 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:50.913766 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6f58e9a2-383c-4605-9f74-15be7331a184 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:50.914199 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6f58e9a2-383c-4605-9f74-15be7331a184 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:50.914884 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6f58e9a2-383c-4605-9f74-15be7331a184 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:50.915331 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6f58e9a2-383c-4605-9f74-15be7331a184 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:50.916060 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6f58e9a2-383c-4605-9f74-15be7331a184 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:51.024491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-93477a24-d727-4a04-8d0d-f0a015e49e93 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:51.025078 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-93477a24-d727-4a04-8d0d-f0a015e49e93 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:51.030924 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-93477a24-d727-4a04-8d0d-f0a015e49e93 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:51.031409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-93477a24-d727-4a04-8d0d-f0a015e49e93 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:51.031846 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-93477a24-d727-4a04-8d0d-f0a015e49e93 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:51.032668 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-93477a24-d727-4a04-8d0d-f0a015e49e93 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:51.033127 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-93477a24-d727-4a04-8d0d-f0a015e49e93 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:51.033559 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-93477a24-d727-4a04-8d0d-f0a015e49e93 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:51.046621 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-6f58e9a2-383c-4605-9f74-15be7331a184 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:51.047227 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-93477a24-d727-4a04-8d0d-f0a015e49e93 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] HTTP exception thrown: Instance 7eafae50-1872-417f-8a14-b794355d89dd could not be found. Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-93477a24-d727-4a04-8d0d-f0a015e49e93 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Request method failure captured: Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: DELETE /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd HTTP/1.1 Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X2l-q93st1NTKOWUoSNz4uC5L8oWUfPa3jS8JHpAVCeTW1mGbeFoKODaiXZyYRao1BGhnJ20yZaMNbtrUT7msoYDSB3YlpJgfZfhj_Jan1czDnjdIEQUDgH1r4F_6GAdOobnqXI3ykMvGs8YyfATdG7G4drvLh92zHTdTFIEqzq2dY Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: ec8246e3b9904e7a8fe4a04269ab0afe Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-AttachVolumeTestJSON-51062467 Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:54:51.048945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:54:51.050551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ec8246e3b9904e7a8fe4a04269ab0afe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ec8246e3b9904e7a8fe4a04269ab0afe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec8246e3b9904e7a8fe4a04269ab0afe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec8246e3b9904e7a8fe4a04269ab0afe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:54:51.050551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-AttachVolumeTestJSON-51062467 Aug 17 23:54:51.050551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: ec8246e3b9904e7a8fe4a04269ab0afe Aug 17 23:54:51.050551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-AttachVolumeTestJSON-51062467 Aug 17 23:54:51.050551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-AttachVolumeTestJSON-51062467-project Aug 17 23:54:51.050551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:54:51.050551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:54:51.050551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 047293a64a9f4857be1621e77094d367 Aug 17 23:54:51.050551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-AttachVolumeTestJSON-51062467-project Aug 17 23:54:51.050551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:54:51.050551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance 7eafae50-1872-417f-8a14-b794355d89dd could not be found. Aug 17 23:54:51.050551 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': '7eafae50-1872-417f-8a14-b794355d89dd'} Aug 17 23:54:51.051487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:54:51.051487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:54:51.051487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:54:51.051487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:54:51.051487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:54:51.051487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:54:51.051487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:54:51.051487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:54:51.051487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:54:51.051487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:54:51.051487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eafae50-1872-417f-8a14-b794355d89dd could not be found. Aug 17 23:54:51.051487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:54:51.051487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:54:51.051487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:54:51.051487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:54:51.051487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:54:51.051487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:54:51.051487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:54:51.051487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:54:51.051487 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:54:51.052959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:54:51.052959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 23:54:51.052959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 23:54:51.052959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 23:54:51.052959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 23:54:51.052959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:54:51.052959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:54:51.052959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:54:51.052959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:54:51.052959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eafae50-1872-417f-8a14-b794355d89dd could not be found. Aug 17 23:54:51.052959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:54:51.052959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:54:51.052959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:54:51.052959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:54:51.052959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:54:51.052959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:54:51.052959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:54:51.052959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:54:51.052959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eafae50-1872-417f-8a14-b794355d89dd could not be found. Aug 17 23:54:51.052959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:54:51.054376 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-93477a24-d727-4a04-8d0d-f0a015e49e93 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Returning 404 to user: Instance 7eafae50-1872-417f-8a14-b794355d89dd could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:54:51.054376 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-93477a24-d727-4a04-8d0d-f0a015e49e93 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 404 len: 111 microversion: 2.1 time: 0.030094 Aug 17 23:54:51.054376 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 672/1323] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:54:51 2022] DELETE /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 23:54:51.054627 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-6f58e9a2-383c-4605-9f74-15be7331a184 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803" status: 200 len: 1514 microversion: 2.1 time: 0.153328 Aug 17 23:54:51.055004 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 652/1324] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:50 2022] GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:51.061632 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-42beb351-9bf5-4b1b-8b36-f90e48d4fe08 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:51.061632 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-42beb351-9bf5-4b1b-8b36-f90e48d4fe08 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 7eafae50-1872-417f-8a14-b794355d89dd] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:51.066257 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-42beb351-9bf5-4b1b-8b36-f90e48d4fe08 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:51.066740 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-42beb351-9bf5-4b1b-8b36-f90e48d4fe08 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:51.067233 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-42beb351-9bf5-4b1b-8b36-f90e48d4fe08 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:51.067919 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-42beb351-9bf5-4b1b-8b36-f90e48d4fe08 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:51.068530 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-42beb351-9bf5-4b1b-8b36-f90e48d4fe08 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:51.068958 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-42beb351-9bf5-4b1b-8b36-f90e48d4fe08 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:51.082683 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-42beb351-9bf5-4b1b-8b36-f90e48d4fe08 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] HTTP exception thrown: Instance 7eafae50-1872-417f-8a14-b794355d89dd could not be found. Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-42beb351-9bf5-4b1b-8b36-f90e48d4fe08 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Request method failure captured: Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd HTTP/1.1 Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X2l-q93st1NTKOWUoSNz4uC5L8oWUfPa3jS8JHpAVCeTW1mGbeFoKODaiXZyYRao1BGhnJ20yZaMNbtrUT7msoYDSB3YlpJgfZfhj_Jan1czDnjdIEQUDgH1r4F_6GAdOobnqXI3ykMvGs8YyfATdG7G4drvLh92zHTdTFIEqzq2dY Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: ec8246e3b9904e7a8fe4a04269ab0afe Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-AttachVolumeTestJSON-51062467 Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:54:51.084205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:54:51.085805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ec8246e3b9904e7a8fe4a04269ab0afe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ec8246e3b9904e7a8fe4a04269ab0afe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec8246e3b9904e7a8fe4a04269ab0afe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec8246e3b9904e7a8fe4a04269ab0afe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:54:51.085805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-AttachVolumeTestJSON-51062467 Aug 17 23:54:51.085805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: ec8246e3b9904e7a8fe4a04269ab0afe Aug 17 23:54:51.085805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-AttachVolumeTestJSON-51062467 Aug 17 23:54:51.085805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-AttachVolumeTestJSON-51062467-project Aug 17 23:54:51.085805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:54:51.085805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:54:51.085805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 047293a64a9f4857be1621e77094d367 Aug 17 23:54:51.085805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-AttachVolumeTestJSON-51062467-project Aug 17 23:54:51.085805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:54:51.085805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance 7eafae50-1872-417f-8a14-b794355d89dd could not be found. Aug 17 23:54:51.085805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': '7eafae50-1872-417f-8a14-b794355d89dd'} Aug 17 23:54:51.086617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:54:51.086617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:54:51.086617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:54:51.086617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:54:51.086617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:54:51.086617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:54:51.086617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:54:51.086617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:54:51.086617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:54:51.086617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:54:51.086617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eafae50-1872-417f-8a14-b794355d89dd could not be found. Aug 17 23:54:51.086617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:54:51.086617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:54:51.086617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:54:51.086617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:54:51.086617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:54:51.086617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:54:51.086617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:54:51.086617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:54:51.086617 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:54:51.087864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:54:51.087864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:54:51.087864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:54:51.087864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:54:51.087864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:54:51.087864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:54:51.087864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:54:51.087864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eafae50-1872-417f-8a14-b794355d89dd could not be found. Aug 17 23:54:51.087864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:54:51.087864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:54:51.087864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:54:51.087864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:54:51.087864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:54:51.087864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:54:51.087864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:54:51.087864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:54:51.087864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eafae50-1872-417f-8a14-b794355d89dd could not be found. Aug 17 23:54:51.087864 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:54:51.089004 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-42beb351-9bf5-4b1b-8b36-f90e48d4fe08 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Returning 404 to user: Instance 7eafae50-1872-417f-8a14-b794355d89dd could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:54:51.089004 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-42beb351-9bf5-4b1b-8b36-f90e48d4fe08 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd" status: 404 len: 111 microversion: 2.1 time: 0.029883 Aug 17 23:54:51.089004 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 673/1325] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:51 2022] GET /compute/v2.1/servers/7eafae50-1872-417f-8a14-b794355d89dd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:54:52.075882 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-b99d94e3-e732-4220-bc8a-611f7517c9ae tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:52.076563 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-b99d94e3-e732-4220-bc8a-611f7517c9ae tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:52.083458 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b99d94e3-e732-4220-bc8a-611f7517c9ae tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:52.083942 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b99d94e3-e732-4220-bc8a-611f7517c9ae tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:52.084402 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b99d94e3-e732-4220-bc8a-611f7517c9ae tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:52.085091 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b99d94e3-e732-4220-bc8a-611f7517c9ae tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:52.085545 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b99d94e3-e732-4220-bc8a-611f7517c9ae tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:52.085971 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-b99d94e3-e732-4220-bc8a-611f7517c9ae tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:52.215511 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-b99d94e3-e732-4220-bc8a-611f7517c9ae tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:52.218300 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-11b1bbbb-39c6-4c51-ad2c-e3bbb60c96c6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:52.218847 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-11b1bbbb-39c6-4c51-ad2c-e3bbb60c96c6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:52.223851 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-b99d94e3-e732-4220-bc8a-611f7517c9ae tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803" status: 200 len: 1514 microversion: 2.1 time: 0.151864 Aug 17 23:54:52.224513 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 653/1326] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:52 2022] GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:52.225929 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-11b1bbbb-39c6-4c51-ad2c-e3bbb60c96c6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:52.226413 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-11b1bbbb-39c6-4c51-ad2c-e3bbb60c96c6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:52.226848 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-11b1bbbb-39c6-4c51-ad2c-e3bbb60c96c6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:52.227542 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-11b1bbbb-39c6-4c51-ad2c-e3bbb60c96c6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:52.228026 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-11b1bbbb-39c6-4c51-ad2c-e3bbb60c96c6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:52.228452 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-11b1bbbb-39c6-4c51-ad2c-e3bbb60c96c6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:52.241666 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-11b1bbbb-39c6-4c51-ad2c-e3bbb60c96c6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] HTTP exception thrown: Instance 16b92554-3f2a-482c-bcf5-1f5f05631227 could not be found. Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-11b1bbbb-39c6-4c51-ad2c-e3bbb60c96c6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Request method failure captured: Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: DELETE /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 HTTP/1.1 Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X2l-q93st1NTKOWUoSNz4uC5L8oWUfPa3jS8JHpAVCeTW1mGbeFoKODaiXZyYRao1BGhnJ20yZaMNbtrUT7msoYDSB3YlpJgfZfhj_Jan1czDnjdIEQUDgH1r4F_6GAdOobnqXI3ykMvGs8YyfATdG7G4drvLh92zHTdTFIEqzq2dY Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: ec8246e3b9904e7a8fe4a04269ab0afe Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-AttachVolumeTestJSON-51062467 Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:54:52.243190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:54:52.244811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ec8246e3b9904e7a8fe4a04269ab0afe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ec8246e3b9904e7a8fe4a04269ab0afe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec8246e3b9904e7a8fe4a04269ab0afe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec8246e3b9904e7a8fe4a04269ab0afe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:54:52.244811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-AttachVolumeTestJSON-51062467 Aug 17 23:54:52.244811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: ec8246e3b9904e7a8fe4a04269ab0afe Aug 17 23:54:52.244811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-AttachVolumeTestJSON-51062467 Aug 17 23:54:52.244811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-AttachVolumeTestJSON-51062467-project Aug 17 23:54:52.244811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:54:52.244811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:54:52.244811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 047293a64a9f4857be1621e77094d367 Aug 17 23:54:52.244811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-AttachVolumeTestJSON-51062467-project Aug 17 23:54:52.244811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:54:52.244811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance 16b92554-3f2a-482c-bcf5-1f5f05631227 could not be found. Aug 17 23:54:52.244811 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': '16b92554-3f2a-482c-bcf5-1f5f05631227'} Aug 17 23:54:52.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:54:52.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:54:52.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:54:52.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:54:52.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:54:52.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:54:52.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:54:52.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:54:52.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:54:52.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:54:52.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16b92554-3f2a-482c-bcf5-1f5f05631227 could not be found. Aug 17 23:54:52.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:54:52.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:54:52.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:54:52.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:54:52.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:54:52.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:54:52.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:54:52.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:54:52.245692 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:54:52.247219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:54:52.247219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 23:54:52.247219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 23:54:52.247219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 23:54:52.247219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 23:54:52.247219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:54:52.247219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:54:52.247219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:54:52.247219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:54:52.247219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16b92554-3f2a-482c-bcf5-1f5f05631227 could not be found. Aug 17 23:54:52.247219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:54:52.247219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:54:52.247219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:54:52.247219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:54:52.247219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:54:52.247219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:54:52.247219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:54:52.247219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:54:52.247219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16b92554-3f2a-482c-bcf5-1f5f05631227 could not be found. Aug 17 23:54:52.247219 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:54:52.248844 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-11b1bbbb-39c6-4c51-ad2c-e3bbb60c96c6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Returning 404 to user: Instance 16b92554-3f2a-482c-bcf5-1f5f05631227 could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:54:52.248844 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-11b1bbbb-39c6-4c51-ad2c-e3bbb60c96c6 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "DELETE /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 404 len: 111 microversion: 2.1 time: 0.030167 Aug 17 23:54:52.248844 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 674/1327] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:54:52 2022] DELETE /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 23:54:52.252840 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-afd5857d-032a-4ae9-8a56-dfbfd97f1276 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:52.253469 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-afd5857d-032a-4ae9-8a56-dfbfd97f1276 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] [instance: 16b92554-3f2a-482c-bcf5-1f5f05631227] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:52.259326 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-afd5857d-032a-4ae9-8a56-dfbfd97f1276 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:52.259865 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-afd5857d-032a-4ae9-8a56-dfbfd97f1276 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:52.260339 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-afd5857d-032a-4ae9-8a56-dfbfd97f1276 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:52.261021 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-afd5857d-032a-4ae9-8a56-dfbfd97f1276 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:52.261472 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-afd5857d-032a-4ae9-8a56-dfbfd97f1276 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:52.261891 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-afd5857d-032a-4ae9-8a56-dfbfd97f1276 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:52.275145 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-afd5857d-032a-4ae9-8a56-dfbfd97f1276 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] HTTP exception thrown: Instance 16b92554-3f2a-482c-bcf5-1f5f05631227 could not be found. Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-afd5857d-032a-4ae9-8a56-dfbfd97f1276 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Request method failure captured: Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 HTTP/1.1 Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X2l-q93st1NTKOWUoSNz4uC5L8oWUfPa3jS8JHpAVCeTW1mGbeFoKODaiXZyYRao1BGhnJ20yZaMNbtrUT7msoYDSB3YlpJgfZfhj_Jan1czDnjdIEQUDgH1r4F_6GAdOobnqXI3ykMvGs8YyfATdG7G4drvLh92zHTdTFIEqzq2dY Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: ec8246e3b9904e7a8fe4a04269ab0afe Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-AttachVolumeTestJSON-51062467 Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:54:52.277051 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:54:52.278610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ec8246e3b9904e7a8fe4a04269ab0afe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ec8246e3b9904e7a8fe4a04269ab0afe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec8246e3b9904e7a8fe4a04269ab0afe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec8246e3b9904e7a8fe4a04269ab0afe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:54:52.278610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-AttachVolumeTestJSON-51062467 Aug 17 23:54:52.278610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: ec8246e3b9904e7a8fe4a04269ab0afe Aug 17 23:54:52.278610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-AttachVolumeTestJSON-51062467 Aug 17 23:54:52.278610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-AttachVolumeTestJSON-51062467-project Aug 17 23:54:52.278610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:54:52.278610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:54:52.278610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 047293a64a9f4857be1621e77094d367 Aug 17 23:54:52.278610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-AttachVolumeTestJSON-51062467-project Aug 17 23:54:52.278610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:54:52.278610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance 16b92554-3f2a-482c-bcf5-1f5f05631227 could not be found. Aug 17 23:54:52.278610 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': '16b92554-3f2a-482c-bcf5-1f5f05631227'} Aug 17 23:54:52.279635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:54:52.279635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:54:52.279635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:54:52.279635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:54:52.279635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:54:52.279635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:54:52.279635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:54:52.279635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:54:52.279635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:54:52.279635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:54:52.279635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16b92554-3f2a-482c-bcf5-1f5f05631227 could not be found. Aug 17 23:54:52.279635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:54:52.279635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:54:52.279635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:54:52.279635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:54:52.279635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:54:52.279635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:54:52.279635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:54:52.279635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:54:52.279635 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:54:52.281097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:54:52.281097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:54:52.281097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:54:52.281097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:54:52.281097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:54:52.281097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:54:52.281097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:54:52.281097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16b92554-3f2a-482c-bcf5-1f5f05631227 could not be found. Aug 17 23:54:52.281097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:54:52.281097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:54:52.281097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:54:52.281097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:54:52.281097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:54:52.281097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:54:52.281097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:54:52.281097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:54:52.281097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16b92554-3f2a-482c-bcf5-1f5f05631227 could not be found. Aug 17 23:54:52.281097 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:54:52.282480 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-afd5857d-032a-4ae9-8a56-dfbfd97f1276 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] Returning 404 to user: Instance 16b92554-3f2a-482c-bcf5-1f5f05631227 could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:54:52.282480 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-afd5857d-032a-4ae9-8a56-dfbfd97f1276 tempest-AttachVolumeTestJSON-51062467 tempest-AttachVolumeTestJSON-51062467-project] 10.222.0.26 "GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227" status: 404 len: 111 microversion: 2.1 time: 0.029326 Aug 17 23:54:52.282480 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 654/1328] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:52 2022] GET /compute/v2.1/servers/16b92554-3f2a-482c-bcf5-1f5f05631227 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 23:54:52.751578 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8d5e7c2e-6179-4c54-b9e4-25db22d8a4d0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:52.752731 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8d5e7c2e-6179-4c54-b9e4-25db22d8a4d0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:52.758659 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8d5e7c2e-6179-4c54-b9e4-25db22d8a4d0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:52.759145 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8d5e7c2e-6179-4c54-b9e4-25db22d8a4d0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:52.759593 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8d5e7c2e-6179-4c54-b9e4-25db22d8a4d0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:52.760407 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8d5e7c2e-6179-4c54-b9e4-25db22d8a4d0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:52.760870 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8d5e7c2e-6179-4c54-b9e4-25db22d8a4d0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:52.761298 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8d5e7c2e-6179-4c54-b9e4-25db22d8a4d0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:52.784357 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8d5e7c2e-6179-4c54-b9e4-25db22d8a4d0 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f/ips" status: 200 len: 149 microversion: 2.1 time: 0.165663 Aug 17 23:54:52.784927 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 675/1329] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Aug 17 23:54:52 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f/ips => generated 149 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:54:53.245010 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1d396762-a217-467e-b103-99f627d0c7d9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:53.245653 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-1d396762-a217-467e-b103-99f627d0c7d9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:53.251982 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1d396762-a217-467e-b103-99f627d0c7d9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:53.252462 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1d396762-a217-467e-b103-99f627d0c7d9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:53.252893 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1d396762-a217-467e-b103-99f627d0c7d9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:53.253583 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1d396762-a217-467e-b103-99f627d0c7d9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:53.254038 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1d396762-a217-467e-b103-99f627d0c7d9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:53.254456 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1d396762-a217-467e-b103-99f627d0c7d9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:53.479287 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-1d396762-a217-467e-b103-99f627d0c7d9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:53.488674 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-1d396762-a217-467e-b103-99f627d0c7d9 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803" status: 200 len: 1514 microversion: 2.1 time: 0.247458 Aug 17 23:54:53.489271 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 655/1330] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:53 2022] GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803 => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:54.127890 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-8e6e1c15-f714-4198-a705-4e3a1fe53bb9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7e94706-5973-4049-9bfe-f6b47f254557"}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:54:54.130986 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-8e6e1c15-f714-4198-a705-4e3a1fe53bb9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:54.137994 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8e6e1c15-f714-4198-a705-4e3a1fe53bb9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:54.138493 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8e6e1c15-f714-4198-a705-4e3a1fe53bb9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:54.138940 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8e6e1c15-f714-4198-a705-4e3a1fe53bb9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:54.139649 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8e6e1c15-f714-4198-a705-4e3a1fe53bb9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:54.140152 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8e6e1c15-f714-4198-a705-4e3a1fe53bb9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:54.140587 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-8e6e1c15-f714-4198-a705-4e3a1fe53bb9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:54.437961 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8e6e1c15-f714-4198-a705-4e3a1fe53bb9 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "POST /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314486 Aug 17 23:54:54.439287 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 676/1331] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Aug 17 23:54:54 2022] POST /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:54:54.516641 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-6ec70fe1-1082-4617-8c67-15f7b676a617 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:54.517275 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-6ec70fe1-1082-4617-8c67-15f7b676a617 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:54.525225 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6ec70fe1-1082-4617-8c67-15f7b676a617 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:54.525913 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6ec70fe1-1082-4617-8c67-15f7b676a617 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:54.526359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6ec70fe1-1082-4617-8c67-15f7b676a617 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:54.527078 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6ec70fe1-1082-4617-8c67-15f7b676a617 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:54.527538 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6ec70fe1-1082-4617-8c67-15f7b676a617 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:54.527995 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6ec70fe1-1082-4617-8c67-15f7b676a617 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:54.809168 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-6ec70fe1-1082-4617-8c67-15f7b676a617 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64fdf46f185c48558ad1a637898745a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '190eae26a0d5487882d1c59c337f0db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:54:54.816866 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-6ec70fe1-1082-4617-8c67-15f7b676a617 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803" status: 200 len: 1514 microversion: 2.1 time: 0.307428 Aug 17 23:54:54.817431 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 656/1332] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:54 2022] GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803 => generated 1514 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:54:54.953663 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-87f7ac53-ccfc-4ecb-a126-e6ca065ac356 req-c51a4250-d993-4006-b126-fdba4acfb28c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85409f9d-3281-4813-8f51-2eedaa92e803", "name": "network-vif-deleted", "tag": "a72b4917-4083-44b3-bc5c-a9f5917243a5"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:54:54.964846 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-87f7ac53-ccfc-4ecb-a126-e6ca065ac356 req-c51a4250-d993-4006-b126-fdba4acfb28c service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:54.965321 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-87f7ac53-ccfc-4ecb-a126-e6ca065ac356 req-c51a4250-d993-4006-b126-fdba4acfb28c service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:54.965745 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-87f7ac53-ccfc-4ecb-a126-e6ca065ac356 req-c51a4250-d993-4006-b126-fdba4acfb28c service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:54.978403 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-87f7ac53-ccfc-4ecb-a126-e6ca065ac356 req-c51a4250-d993-4006-b126-fdba4acfb28c service nova] Creating event network-vif-deleted:a72b4917-4083-44b3-bc5c-a9f5917243a5 for instance 85409f9d-3281-4813-8f51-2eedaa92e803 on hv-cinder-82002 Aug 17 23:54:54.984031 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-87f7ac53-ccfc-4ecb-a126-e6ca065ac356 req-c51a4250-d993-4006-b126-fdba4acfb28c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035670 Aug 17 23:54:54.984962 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 677/1333] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:54:55.838237 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-110fb2b7-532d-4c20-ad29-7e9f7b726974 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:54:55.838773 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-110fb2b7-532d-4c20-ad29-7e9f7b726974 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] [instance: 85409f9d-3281-4813-8f51-2eedaa92e803] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:54:55.845278 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-110fb2b7-532d-4c20-ad29-7e9f7b726974 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:55.845774 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-110fb2b7-532d-4c20-ad29-7e9f7b726974 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:55.846744 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-110fb2b7-532d-4c20-ad29-7e9f7b726974 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:55.847430 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-110fb2b7-532d-4c20-ad29-7e9f7b726974 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:54:55.847886 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-110fb2b7-532d-4c20-ad29-7e9f7b726974 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:54:55.848413 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-110fb2b7-532d-4c20-ad29-7e9f7b726974 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:54:55.861486 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-110fb2b7-532d-4c20-ad29-7e9f7b726974 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] HTTP exception thrown: Instance 85409f9d-3281-4813-8f51-2eedaa92e803 could not be found. Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-110fb2b7-532d-4c20-ad29-7e9f7b726974 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Request method failure captured: Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803 HTTP/1.1 Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X86QblTMGu2YP4Fxo4SxKAi4pajrj3J2tbCF0Dwvm-ijx923isPEyJFgk1lduQU97vQ9ojnd202B_NRCwIazHjIj1MmeiUeVB5tbZhHh8gU5A3WCaf4ltJlTQoEFNgmsYmyyBMJ_GYMfWTfqS-GtuDsZLGMMQjqaqfh2tR7wegXc-M Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: 190eae26a0d5487882d1c59c337f0db4 Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1475852364 Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:54:55.863117 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:54:55.872459 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/190eae26a0d5487882d1c59c337f0db4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_190eae26a0d5487882d1c59c337f0db4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/190eae26a0d5487882d1c59c337f0db4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/190eae26a0d5487882d1c59c337f0db4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:54:55.872459 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-VolumesSnapshotTestJSON-1475852364 Aug 17 23:54:55.872459 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: 190eae26a0d5487882d1c59c337f0db4 Aug 17 23:54:55.872459 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1475852364 Aug 17 23:54:55.872459 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-VolumesSnapshotTestJSON-1475852364-project Aug 17 23:54:55.872459 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:54:55.872459 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:54:55.872459 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 64fdf46f185c48558ad1a637898745a9 Aug 17 23:54:55.872459 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-VolumesSnapshotTestJSON-1475852364-project Aug 17 23:54:55.872459 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:54:55.872459 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance 85409f9d-3281-4813-8f51-2eedaa92e803 could not be found. Aug 17 23:54:55.872459 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': '85409f9d-3281-4813-8f51-2eedaa92e803'} Aug 17 23:54:55.873401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:54:55.873401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:54:55.873401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:54:55.873401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:54:55.873401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:54:55.873401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:54:55.873401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:54:55.873401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:54:55.873401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:54:55.873401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:54:55.873401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85409f9d-3281-4813-8f51-2eedaa92e803 could not be found. Aug 17 23:54:55.873401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:54:55.873401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:54:55.873401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:54:55.873401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:54:55.873401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:54:55.873401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:54:55.873401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:54:55.873401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:54:55.873401 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:54:55.874874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:54:55.874874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:54:55.874874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:54:55.874874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:54:55.874874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:54:55.874874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:54:55.874874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:54:55.874874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85409f9d-3281-4813-8f51-2eedaa92e803 could not be found. Aug 17 23:54:55.874874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:54:55.874874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:54:55.874874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:54:55.874874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:54:55.874874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:54:55.874874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:54:55.874874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:54:55.874874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:54:55.874874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85409f9d-3281-4813-8f51-2eedaa92e803 could not be found. Aug 17 23:54:55.874874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:54:55.881306 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-110fb2b7-532d-4c20-ad29-7e9f7b726974 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] Returning 404 to user: Instance 85409f9d-3281-4813-8f51-2eedaa92e803 could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:54:55.881306 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-110fb2b7-532d-4c20-ad29-7e9f7b726974 tempest-VolumesSnapshotTestJSON-1475852364 tempest-VolumesSnapshotTestJSON-1475852364-project] 10.222.0.26 "GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803" status: 404 len: 111 microversion: 2.1 time: 0.031192 Aug 17 23:54:55.881306 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 657/1334] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:54:55 2022] GET /compute/v2.1/servers/85409f9d-3281-4813-8f51-2eedaa92e803 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:55:03.171710 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e436b2dc-42df-4986-a03b-3908f943d111 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:03.173005 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e436b2dc-42df-4986-a03b-3908f943d111 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:03.181004 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e436b2dc-42df-4986-a03b-3908f943d111 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:03.181510 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e436b2dc-42df-4986-a03b-3908f943d111 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:03.181934 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e436b2dc-42df-4986-a03b-3908f943d111 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:03.182639 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e436b2dc-42df-4986-a03b-3908f943d111 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:03.183098 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e436b2dc-42df-4986-a03b-3908f943d111 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:03.183523 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e436b2dc-42df-4986-a03b-3908f943d111 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:03.274290 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.objects.instance [None req-e436b2dc-42df-4986-a03b-3908f943d111 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lazy-loading 'services' on Instance uuid 1475417e-aa50-4335-8388-b236aab8881f {{(pid=131394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:55:03.348884 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e436b2dc-42df-4986-a03b-3908f943d111 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f/os-volume_attachments/d7e94706-5973-4049-9bfe-f6b47f254557" status: 202 len: 0 microversion: 2.1 time: 0.181393 Aug 17 23:55:03.349683 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 678/1335] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Aug 17 23:55:03 2022] DELETE /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f/os-volume_attachments/d7e94706-5973-4049-9bfe-f6b47f254557 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:55:03.357928 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e2045b91-b6c4-4470-9f69-17624c0ccd6a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:03.360244 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e2045b91-b6c4-4470-9f69-17624c0ccd6a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:03.368049 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e2045b91-b6c4-4470-9f69-17624c0ccd6a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:03.368552 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e2045b91-b6c4-4470-9f69-17624c0ccd6a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:03.369026 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e2045b91-b6c4-4470-9f69-17624c0ccd6a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:03.369826 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e2045b91-b6c4-4470-9f69-17624c0ccd6a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:03.370291 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e2045b91-b6c4-4470-9f69-17624c0ccd6a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:03.370727 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e2045b91-b6c4-4470-9f69-17624c0ccd6a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:03.407633 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e2045b91-b6c4-4470-9f69-17624c0ccd6a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053535 Aug 17 23:55:03.408422 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 658/1336] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:55:03 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:55:03.893970 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-db621478-6ad5-49df-948d-704cc82a0d71 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:03.896309 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-db621478-6ad5-49df-948d-704cc82a0d71 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:03.903097 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-db621478-6ad5-49df-948d-704cc82a0d71 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:03.903592 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-db621478-6ad5-49df-948d-704cc82a0d71 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:03.904074 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-db621478-6ad5-49df-948d-704cc82a0d71 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:03.904792 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-db621478-6ad5-49df-948d-704cc82a0d71 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:03.905253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-db621478-6ad5-49df-948d-704cc82a0d71 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:03.905682 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-db621478-6ad5-49df-948d-704cc82a0d71 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:03.937296 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-db621478-6ad5-49df-948d-704cc82a0d71 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048138 Aug 17 23:55:03.937891 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 679/1337] 10.222.0.26 () {60 vars in 1343 bytes} [Wed Aug 17 23:55:03 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:55:04.012716 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-80e87319-5ac3-46f5-867e-c9e7ef9fca71 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:04.013217 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-80e87319-5ac3-46f5-867e-c9e7ef9fca71 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:04.021464 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-80e87319-5ac3-46f5-867e-c9e7ef9fca71 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:04.022166 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-80e87319-5ac3-46f5-867e-c9e7ef9fca71 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:04.022600 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-80e87319-5ac3-46f5-867e-c9e7ef9fca71 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:04.023304 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-80e87319-5ac3-46f5-867e-c9e7ef9fca71 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:04.023753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-80e87319-5ac3-46f5-867e-c9e7ef9fca71 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:04.024272 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-80e87319-5ac3-46f5-867e-c9e7ef9fca71 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:04.028739 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:55:04.058298 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-80e87319-5ac3-46f5-867e-c9e7ef9fca71 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Going to try to terminate instance {{(pid=131395) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:55:04.148056 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-80e87319-5ac3-46f5-867e-c9e7ef9fca71 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "DELETE /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 204 len: 0 microversion: 2.20 time: 0.138742 Aug 17 23:55:04.149228 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 659/1338] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Aug 17 23:55:04 2022] DELETE /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 23:55:04.157936 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9ceb3203-8d50-444c-baf9-6a7aecb3435c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:04.158568 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9ceb3203-8d50-444c-baf9-6a7aecb3435c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:04.167187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9ceb3203-8d50-444c-baf9-6a7aecb3435c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:04.167689 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9ceb3203-8d50-444c-baf9-6a7aecb3435c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:04.168171 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9ceb3203-8d50-444c-baf9-6a7aecb3435c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:04.168879 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9ceb3203-8d50-444c-baf9-6a7aecb3435c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:04.169341 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9ceb3203-8d50-444c-baf9-6a7aecb3435c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:04.169776 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9ceb3203-8d50-444c-baf9-6a7aecb3435c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:04.308575 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9ceb3203-8d50-444c-baf9-6a7aecb3435c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:04.318375 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9ceb3203-8d50-444c-baf9-6a7aecb3435c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:04.320094 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9ceb3203-8d50-444c-baf9-6a7aecb3435c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:04.321261 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9ceb3203-8d50-444c-baf9-6a7aecb3435c tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1722 microversion: 2.20 time: 0.167788 Aug 17 23:55:04.321821 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 680/1339] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:55:04 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:55:04.421065 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-96f725bb-0290-471c-9fb0-374aa1484a53 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:04.423371 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-96f725bb-0290-471c-9fb0-374aa1484a53 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:04.430599 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-96f725bb-0290-471c-9fb0-374aa1484a53 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:04.431096 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-96f725bb-0290-471c-9fb0-374aa1484a53 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:04.431542 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-96f725bb-0290-471c-9fb0-374aa1484a53 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:04.432361 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-96f725bb-0290-471c-9fb0-374aa1484a53 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:04.432827 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-96f725bb-0290-471c-9fb0-374aa1484a53 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:04.433257 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-96f725bb-0290-471c-9fb0-374aa1484a53 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:04.463799 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-96f725bb-0290-471c-9fb0-374aa1484a53 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047444 Aug 17 23:55:04.464437 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 660/1340] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:55:04 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:55:05.345846 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-75c46a67-48f0-4b87-978a-f2ab3fc45cb3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:05.346521 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-75c46a67-48f0-4b87-978a-f2ab3fc45cb3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:05.353222 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-75c46a67-48f0-4b87-978a-f2ab3fc45cb3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:05.353855 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-75c46a67-48f0-4b87-978a-f2ab3fc45cb3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:05.354503 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-75c46a67-48f0-4b87-978a-f2ab3fc45cb3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:05.355205 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-75c46a67-48f0-4b87-978a-f2ab3fc45cb3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:05.355639 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-75c46a67-48f0-4b87-978a-f2ab3fc45cb3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:05.356187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-75c46a67-48f0-4b87-978a-f2ab3fc45cb3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:05.482750 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-11c9219b-31d4-41a4-9e08-61ccdf7cd6fa tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:05.482750 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-11c9219b-31d4-41a4-9e08-61ccdf7cd6fa tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:05.489293 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-11c9219b-31d4-41a4-9e08-61ccdf7cd6fa tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:05.489875 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-11c9219b-31d4-41a4-9e08-61ccdf7cd6fa tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:05.490575 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-11c9219b-31d4-41a4-9e08-61ccdf7cd6fa tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:05.491838 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-11c9219b-31d4-41a4-9e08-61ccdf7cd6fa tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:05.492811 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-11c9219b-31d4-41a4-9e08-61ccdf7cd6fa tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:05.493746 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-11c9219b-31d4-41a4-9e08-61ccdf7cd6fa tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:05.510429 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-75c46a67-48f0-4b87-978a-f2ab3fc45cb3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:05.524502 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-75c46a67-48f0-4b87-978a-f2ab3fc45cb3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:05.527917 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-11c9219b-31d4-41a4-9e08-61ccdf7cd6fa tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055119 Aug 17 23:55:05.529075 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 661/1341] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:55:05 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:55:05.532016 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-75c46a67-48f0-4b87-978a-f2ab3fc45cb3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:05.533253 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-75c46a67-48f0-4b87-978a-f2ab3fc45cb3 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1722 microversion: 2.20 time: 0.191735 Aug 17 23:55:05.533872 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 681/1342] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:55:05 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:55:06.541461 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-f0f126db-a706-4218-838b-12ba39d66e6c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:06.543622 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-f0f126db-a706-4218-838b-12ba39d66e6c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:06.550052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f0f126db-a706-4218-838b-12ba39d66e6c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:06.550534 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f0f126db-a706-4218-838b-12ba39d66e6c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:06.550976 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f0f126db-a706-4218-838b-12ba39d66e6c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:06.551680 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f0f126db-a706-4218-838b-12ba39d66e6c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:06.552161 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f0f126db-a706-4218-838b-12ba39d66e6c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:06.552618 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-f0f126db-a706-4218-838b-12ba39d66e6c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:06.559247 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-dbac5f51-8bb6-4b75-9d69-1c504b30e432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:06.560100 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-dbac5f51-8bb6-4b75-9d69-1c504b30e432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:06.566806 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dbac5f51-8bb6-4b75-9d69-1c504b30e432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:06.567380 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dbac5f51-8bb6-4b75-9d69-1c504b30e432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:06.568244 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dbac5f51-8bb6-4b75-9d69-1c504b30e432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:06.569576 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dbac5f51-8bb6-4b75-9d69-1c504b30e432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:06.570956 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dbac5f51-8bb6-4b75-9d69-1c504b30e432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:06.572172 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-dbac5f51-8bb6-4b75-9d69-1c504b30e432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:06.594194 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-f0f126db-a706-4218-838b-12ba39d66e6c tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056983 Aug 17 23:55:06.595558 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 662/1343] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Aug 17 23:55:06 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 23:55:06.665174 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-eff21bb2-055a-4cd5-87bd-b20dded407ba tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:06.666994 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-eff21bb2-055a-4cd5-87bd-b20dded407ba tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:06.677278 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eff21bb2-055a-4cd5-87bd-b20dded407ba tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:06.678138 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eff21bb2-055a-4cd5-87bd-b20dded407ba tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:06.678824 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eff21bb2-055a-4cd5-87bd-b20dded407ba tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:06.679773 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eff21bb2-055a-4cd5-87bd-b20dded407ba tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:06.680310 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eff21bb2-055a-4cd5-87bd-b20dded407ba tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:06.680983 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-eff21bb2-055a-4cd5-87bd-b20dded407ba tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:06.719697 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-eff21bb2-055a-4cd5-87bd-b20dded407ba tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Going to try to terminate instance {{(pid=131395) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:55:06.726557 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dbac5f51-8bb6-4b75-9d69-1c504b30e432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:06.736935 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dbac5f51-8bb6-4b75-9d69-1c504b30e432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:06.738409 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-dbac5f51-8bb6-4b75-9d69-1c504b30e432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:06.739995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-dbac5f51-8bb6-4b75-9d69-1c504b30e432 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1722 microversion: 2.20 time: 0.185688 Aug 17 23:55:06.740713 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 682/1344] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:55:06 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:55:06.817458 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-eff21bb2-055a-4cd5-87bd-b20dded407ba tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 204 len: 0 microversion: 2.1 time: 0.155823 Aug 17 23:55:06.819602 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 663/1345] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:55:06 2022] DELETE /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 23:55:06.828207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-047e0203-a1b3-4af6-b14c-5340ca6a6a99 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:06.828970 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-047e0203-a1b3-4af6-b14c-5340ca6a6a99 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:06.836905 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-047e0203-a1b3-4af6-b14c-5340ca6a6a99 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:06.837533 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-047e0203-a1b3-4af6-b14c-5340ca6a6a99 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:06.838086 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-047e0203-a1b3-4af6-b14c-5340ca6a6a99 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:06.838886 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-047e0203-a1b3-4af6-b14c-5340ca6a6a99 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:06.839437 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-047e0203-a1b3-4af6-b14c-5340ca6a6a99 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:06.839955 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-047e0203-a1b3-4af6-b14c-5340ca6a6a99 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:06.973006 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-047e0203-a1b3-4af6-b14c-5340ca6a6a99 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:06.980980 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-047e0203-a1b3-4af6-b14c-5340ca6a6a99 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 200 len: 1680 microversion: 2.1 time: 0.157080 Aug 17 23:55:06.981636 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 683/1346] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:55:06 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:55:07.385625 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-1bf585e0-6e3c-4f76-89f3-21d86f26e521 req-a7111b06-4eb4-4eca-af77-08c13ec36602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011c37dd-ede6-411d-b147-395b6e36ec9d", "name": "network-vif-deleted", "tag": "1cf07451-1bbc-4e01-a03f-428d2ab9b4b7"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:55:07.395168 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-1bf585e0-6e3c-4f76-89f3-21d86f26e521 req-a7111b06-4eb4-4eca-af77-08c13ec36602 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:07.395637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-1bf585e0-6e3c-4f76-89f3-21d86f26e521 req-a7111b06-4eb4-4eca-af77-08c13ec36602 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:07.396093 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-1bf585e0-6e3c-4f76-89f3-21d86f26e521 req-a7111b06-4eb4-4eca-af77-08c13ec36602 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:07.407010 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-1bf585e0-6e3c-4f76-89f3-21d86f26e521 req-a7111b06-4eb4-4eca-af77-08c13ec36602 service nova] Creating event network-vif-deleted:1cf07451-1bbc-4e01-a03f-428d2ab9b4b7 for instance 011c37dd-ede6-411d-b147-395b6e36ec9d on hv-cinder-82002 Aug 17 23:55:07.412351 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-1bf585e0-6e3c-4f76-89f3-21d86f26e521 req-a7111b06-4eb4-4eca-af77-08c13ec36602 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033318 Aug 17 23:55:07.413141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 664/1347] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:55:07.763488 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-df92bc4f-f733-4040-9406-6d63d1bf17c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:07.764120 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-df92bc4f-f733-4040-9406-6d63d1bf17c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:07.771300 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df92bc4f-f733-4040-9406-6d63d1bf17c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:07.771823 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df92bc4f-f733-4040-9406-6d63d1bf17c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:07.772322 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df92bc4f-f733-4040-9406-6d63d1bf17c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:07.773026 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df92bc4f-f733-4040-9406-6d63d1bf17c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:07.773486 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df92bc4f-f733-4040-9406-6d63d1bf17c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:07.773916 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-df92bc4f-f733-4040-9406-6d63d1bf17c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:07.839413 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-df92bc4f-f733-4040-9406-6d63d1bf17c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:07.847516 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-df92bc4f-f733-4040-9406-6d63d1bf17c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:07.849038 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-df92bc4f-f733-4040-9406-6d63d1bf17c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:07.850194 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-df92bc4f-f733-4040-9406-6d63d1bf17c5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1655 microversion: 2.20 time: 0.090699 Aug 17 23:55:07.850752 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 684/1348] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:55:07 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1655 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:55:08.004292 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-95baa855-e53c-4ddf-bf22-b5eeb42dbc6e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:08.004990 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-95baa855-e53c-4ddf-bf22-b5eeb42dbc6e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:08.011454 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-95baa855-e53c-4ddf-bf22-b5eeb42dbc6e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:08.011947 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-95baa855-e53c-4ddf-bf22-b5eeb42dbc6e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:08.012418 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-95baa855-e53c-4ddf-bf22-b5eeb42dbc6e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:08.013124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-95baa855-e53c-4ddf-bf22-b5eeb42dbc6e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:08.013628 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-95baa855-e53c-4ddf-bf22-b5eeb42dbc6e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:08.014003 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-95baa855-e53c-4ddf-bf22-b5eeb42dbc6e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:08.149397 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-95baa855-e53c-4ddf-bf22-b5eeb42dbc6e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:08.157547 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-95baa855-e53c-4ddf-bf22-b5eeb42dbc6e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 200 len: 1680 microversion: 2.1 time: 0.158599 Aug 17 23:55:08.158131 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 665/1349] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:55:07 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:55:08.874655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-2e5098ba-a263-473b-a68e-7bb03728febf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:08.875266 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-2e5098ba-a263-473b-a68e-7bb03728febf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:08.881604 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2e5098ba-a263-473b-a68e-7bb03728febf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:08.882075 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2e5098ba-a263-473b-a68e-7bb03728febf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:08.882506 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2e5098ba-a263-473b-a68e-7bb03728febf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:08.883185 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2e5098ba-a263-473b-a68e-7bb03728febf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:08.883634 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2e5098ba-a263-473b-a68e-7bb03728febf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:08.884080 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-2e5098ba-a263-473b-a68e-7bb03728febf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:08.946013 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-2e5098ba-a263-473b-a68e-7bb03728febf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:08.953952 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-2e5098ba-a263-473b-a68e-7bb03728febf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:08.955462 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-2e5098ba-a263-473b-a68e-7bb03728febf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:08.957264 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-2e5098ba-a263-473b-a68e-7bb03728febf tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1655 microversion: 2.20 time: 0.086560 Aug 17 23:55:08.957831 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 685/1350] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:55:08 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1655 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:55:09.180136 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a61bc19a-5d57-4e14-abad-a3370c61ee6f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:09.180680 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a61bc19a-5d57-4e14-abad-a3370c61ee6f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:09.187239 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a61bc19a-5d57-4e14-abad-a3370c61ee6f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:09.187727 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a61bc19a-5d57-4e14-abad-a3370c61ee6f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:09.188196 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a61bc19a-5d57-4e14-abad-a3370c61ee6f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:09.188896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a61bc19a-5d57-4e14-abad-a3370c61ee6f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:09.189354 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a61bc19a-5d57-4e14-abad-a3370c61ee6f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:09.189783 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a61bc19a-5d57-4e14-abad-a3370c61ee6f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:09.316132 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a61bc19a-5d57-4e14-abad-a3370c61ee6f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:09.323562 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a61bc19a-5d57-4e14-abad-a3370c61ee6f tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 200 len: 1680 microversion: 2.1 time: 0.147349 Aug 17 23:55:09.324158 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 666/1351] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:55:09 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:55:09.980590 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-6c4a5478-c747-4910-8891-8f2e83f1e3fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:09.981209 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-6c4a5478-c747-4910-8891-8f2e83f1e3fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:09.983689 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:55:09.988881 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6c4a5478-c747-4910-8891-8f2e83f1e3fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:09.989365 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6c4a5478-c747-4910-8891-8f2e83f1e3fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:09.989807 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6c4a5478-c747-4910-8891-8f2e83f1e3fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:09.990496 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6c4a5478-c747-4910-8891-8f2e83f1e3fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:09.990953 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6c4a5478-c747-4910-8891-8f2e83f1e3fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:09.991382 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6c4a5478-c747-4910-8891-8f2e83f1e3fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:10.054013 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-6c4a5478-c747-4910-8891-8f2e83f1e3fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:10.061786 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-6c4a5478-c747-4910-8891-8f2e83f1e3fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:10.063291 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-6c4a5478-c747-4910-8891-8f2e83f1e3fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:10.064476 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-6c4a5478-c747-4910-8891-8f2e83f1e3fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1655 microversion: 2.20 time: 0.087805 Aug 17 23:55:10.065596 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 686/1352] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:55:09 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1655 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:55:10.345408 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e9a1e3fb-b6b3-4aa6-9a47-95cb0176035a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:10.346025 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e9a1e3fb-b6b3-4aa6-9a47-95cb0176035a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:10.348505 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:55:10.354389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e9a1e3fb-b6b3-4aa6-9a47-95cb0176035a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:10.354874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e9a1e3fb-b6b3-4aa6-9a47-95cb0176035a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:10.355309 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e9a1e3fb-b6b3-4aa6-9a47-95cb0176035a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:10.356059 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e9a1e3fb-b6b3-4aa6-9a47-95cb0176035a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:10.356510 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e9a1e3fb-b6b3-4aa6-9a47-95cb0176035a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:10.356961 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e9a1e3fb-b6b3-4aa6-9a47-95cb0176035a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:10.490448 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-e9a1e3fb-b6b3-4aa6-9a47-95cb0176035a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:10.498778 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e9a1e3fb-b6b3-4aa6-9a47-95cb0176035a tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 200 len: 1680 microversion: 2.1 time: 0.157210 Aug 17 23:55:10.499601 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 667/1353] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:55:10 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:55:11.087143 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-077db6b2-e6f9-4c77-bf40-ea9f5fe4a0a5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:11.087755 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-077db6b2-e6f9-4c77-bf40-ea9f5fe4a0a5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:11.094153 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-077db6b2-e6f9-4c77-bf40-ea9f5fe4a0a5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:11.094662 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-077db6b2-e6f9-4c77-bf40-ea9f5fe4a0a5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:11.095096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-077db6b2-e6f9-4c77-bf40-ea9f5fe4a0a5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:11.095795 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-077db6b2-e6f9-4c77-bf40-ea9f5fe4a0a5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:11.096869 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-077db6b2-e6f9-4c77-bf40-ea9f5fe4a0a5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:11.097296 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-077db6b2-e6f9-4c77-bf40-ea9f5fe4a0a5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:11.099801 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:55:11.160902 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-077db6b2-e6f9-4c77-bf40-ea9f5fe4a0a5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:11.169140 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-077db6b2-e6f9-4c77-bf40-ea9f5fe4a0a5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:11.170653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-077db6b2-e6f9-4c77-bf40-ea9f5fe4a0a5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:11.171799 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-077db6b2-e6f9-4c77-bf40-ea9f5fe4a0a5 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1655 microversion: 2.20 time: 0.088598 Aug 17 23:55:11.172390 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 687/1354] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:55:11 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1655 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:55:11.521531 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-5b346c43-5988-4e0f-bd30-5ae5505eb85d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:11.522148 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-5b346c43-5988-4e0f-bd30-5ae5505eb85d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:11.528508 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5b346c43-5988-4e0f-bd30-5ae5505eb85d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:11.528987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5b346c43-5988-4e0f-bd30-5ae5505eb85d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:11.529427 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5b346c43-5988-4e0f-bd30-5ae5505eb85d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:11.530107 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5b346c43-5988-4e0f-bd30-5ae5505eb85d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:11.530556 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5b346c43-5988-4e0f-bd30-5ae5505eb85d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:11.531002 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-5b346c43-5988-4e0f-bd30-5ae5505eb85d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:11.657394 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-5b346c43-5988-4e0f-bd30-5ae5505eb85d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:11.664995 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-5b346c43-5988-4e0f-bd30-5ae5505eb85d tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 200 len: 1680 microversion: 2.1 time: 0.147909 Aug 17 23:55:11.665510 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 668/1355] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:55:11 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:55:12.194390 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-5ec3838a-7bd1-4c16-b62e-8bdf232540e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:12.195004 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-5ec3838a-7bd1-4c16-b62e-8bdf232540e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:12.201423 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5ec3838a-7bd1-4c16-b62e-8bdf232540e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:12.201928 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5ec3838a-7bd1-4c16-b62e-8bdf232540e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:12.202348 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5ec3838a-7bd1-4c16-b62e-8bdf232540e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:12.203037 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5ec3838a-7bd1-4c16-b62e-8bdf232540e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:12.203492 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5ec3838a-7bd1-4c16-b62e-8bdf232540e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:12.203918 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5ec3838a-7bd1-4c16-b62e-8bdf232540e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:12.233783 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5ec3838a-7bd1-4c16-b62e-8bdf232540e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:12.234186 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5ec3838a-7bd1-4c16-b62e-8bdf232540e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:12.234620 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5ec3838a-7bd1-4c16-b62e-8bdf232540e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:12.235061 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.objects.instance [None req-5ec3838a-7bd1-4c16-b62e-8bdf232540e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lazy-loading 'fault' on Instance uuid 011c37dd-ede6-411d-b147-395b6e36ec9d {{(pid=131394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:55:12.275295 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5ec3838a-7bd1-4c16-b62e-8bdf232540e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:12.282983 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5ec3838a-7bd1-4c16-b62e-8bdf232540e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:12.285139 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-5ec3838a-7bd1-4c16-b62e-8bdf232540e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2da686247e7f490ab7924d0456da60d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9574c6bc0ea4f78a0145fc2764a6fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:12.286316 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-5ec3838a-7bd1-4c16-b62e-8bdf232540e6 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 200 len: 1372 microversion: 2.20 time: 0.095856 Aug 17 23:55:12.286875 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 688/1356] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:55:12 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 23:55:12.686875 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-09867efd-1ccb-47d0-822e-2a0688b7d4a8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:12.687482 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-09867efd-1ccb-47d0-822e-2a0688b7d4a8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:12.694283 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-09867efd-1ccb-47d0-822e-2a0688b7d4a8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:12.694787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-09867efd-1ccb-47d0-822e-2a0688b7d4a8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:12.695219 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-09867efd-1ccb-47d0-822e-2a0688b7d4a8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:12.695916 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-09867efd-1ccb-47d0-822e-2a0688b7d4a8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:12.696395 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-09867efd-1ccb-47d0-822e-2a0688b7d4a8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:12.696817 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-09867efd-1ccb-47d0-822e-2a0688b7d4a8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:12.833548 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-09867efd-1ccb-47d0-822e-2a0688b7d4a8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:12.841977 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-09867efd-1ccb-47d0-822e-2a0688b7d4a8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 200 len: 1680 microversion: 2.1 time: 0.158802 Aug 17 23:55:12.842695 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 669/1357] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:55:12 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:55:13.309472 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-cb133214-8355-4520-b8df-00ceb73e77c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:13.310086 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-cb133214-8355-4520-b8df-00ceb73e77c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:13.318238 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cb133214-8355-4520-b8df-00ceb73e77c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:13.319128 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cb133214-8355-4520-b8df-00ceb73e77c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:13.319569 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cb133214-8355-4520-b8df-00ceb73e77c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:13.320477 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cb133214-8355-4520-b8df-00ceb73e77c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:13.320935 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cb133214-8355-4520-b8df-00ceb73e77c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:13.321543 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cb133214-8355-4520-b8df-00ceb73e77c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:13.337322 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-cb133214-8355-4520-b8df-00ceb73e77c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] HTTP exception thrown: Instance 011c37dd-ede6-411d-b147-395b6e36ec9d could not be found. Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-cb133214-8355-4520-b8df-00ceb73e77c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Request method failure captured: Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d HTTP/1.1 Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X0gZE9JlbYKTrrLiW4VAbW3COer-I9kHd2IqEFzvb3q6K2--HStbtrYSQEwHc0VJYBmCOAMxPH9VaJ2a5Ezse8PxLuEhuMa9MOQzMvq7y53bOiv3GyTjnby9zW3Dzuh1lONZvvKOsoAO5tKYLtmbwRNqtn_SsQmbGPgAPNlHJTeSWo Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: d9574c6bc0ea4f78a0145fc2764a6fa9 Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1876855194 Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:55:13.339184 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:55:13.340959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d9574c6bc0ea4f78a0145fc2764a6fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d9574c6bc0ea4f78a0145fc2764a6fa9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9574c6bc0ea4f78a0145fc2764a6fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9574c6bc0ea4f78a0145fc2764a6fa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:55:13.340959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1876855194 Aug 17 23:55:13.340959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: d9574c6bc0ea4f78a0145fc2764a6fa9 Aug 17 23:55:13.340959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1876855194 Aug 17 23:55:13.340959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-AttachVolumeShelveTestJSON-1876855194-project Aug 17 23:55:13.340959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:55:13.340959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:55:13.340959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 2da686247e7f490ab7924d0456da60d5 Aug 17 23:55:13.340959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1876855194-project Aug 17 23:55:13.340959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:55:13.340959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance 011c37dd-ede6-411d-b147-395b6e36ec9d could not be found. Aug 17 23:55:13.340959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': '011c37dd-ede6-411d-b147-395b6e36ec9d'} Aug 17 23:55:13.341887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:55:13.341887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:13.341887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:55:13.341887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:55:13.341887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:55:13.341887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:55:13.341887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:55:13.341887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:55:13.341887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:55:13.341887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:55:13.341887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 011c37dd-ede6-411d-b147-395b6e36ec9d could not be found. Aug 17 23:55:13.341887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:13.341887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:13.341887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:13.341887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:13.341887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:13.341887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:13.341887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:55:13.341887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:55:13.341887 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:55:13.343815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:55:13.343815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:55:13.343815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:55:13.343815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:55:13.343815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:55:13.343815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:55:13.343815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:55:13.343815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 011c37dd-ede6-411d-b147-395b6e36ec9d could not be found. Aug 17 23:55:13.343815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:13.343815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:13.343815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:13.343815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:13.343815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:13.343815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:13.343815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:55:13.343815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:55:13.343815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 011c37dd-ede6-411d-b147-395b6e36ec9d could not be found. Aug 17 23:55:13.343815 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:13.347941 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-cb133214-8355-4520-b8df-00ceb73e77c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Returning 404 to user: Instance 011c37dd-ede6-411d-b147-395b6e36ec9d could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:55:13.349026 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-cb133214-8355-4520-b8df-00ceb73e77c0 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 404 len: 111 microversion: 2.20 time: 0.043493 Aug 17 23:55:13.349714 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 689/1358] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:55:13 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 23:55:13.357903 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-8b429f28-7788-4c3c-b4db-883a8570c561 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '.version_select at 0x7f85fd4f0160>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:13.379343 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-8b429f28-7788-4c3c-b4db-883a8570c561 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1499061896" status: 204 len: 0 microversion: 2.20 time: 0.024717 Aug 17 23:55:13.379930 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 670/1359] 10.222.0.26 () {60 vars in 1262 bytes} [Wed Aug 17 23:55:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1499061896 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 23:55:13.864802 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-d80a42c8-2265-4198-9fa1-30fbb8ef6e36 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:13.865782 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-d80a42c8-2265-4198-9fa1-30fbb8ef6e36 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:13.876777 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d80a42c8-2265-4198-9fa1-30fbb8ef6e36 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:13.877386 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d80a42c8-2265-4198-9fa1-30fbb8ef6e36 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:13.877943 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d80a42c8-2265-4198-9fa1-30fbb8ef6e36 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:13.878940 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d80a42c8-2265-4198-9fa1-30fbb8ef6e36 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:13.879620 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d80a42c8-2265-4198-9fa1-30fbb8ef6e36 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:13.880150 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-d80a42c8-2265-4198-9fa1-30fbb8ef6e36 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:14.123424 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-d80a42c8-2265-4198-9fa1-30fbb8ef6e36 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e06d9bb5a240459ef3298a990a42f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '258851d93c2d466a85150116d68441b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:55:14.131838 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-d80a42c8-2265-4198-9fa1-30fbb8ef6e36 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 200 len: 1680 microversion: 2.1 time: 0.272361 Aug 17 23:55:14.132449 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 690/1360] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:55:13 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 1680 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:55:14.429760 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-1613dbc5-6297-4fe0-9fbb-e4065864c6b1 req-20193b53-34b2-4a62-af8e-14a99cfce844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1475417e-aa50-4335-8388-b236aab8881f", "name": "network-vif-deleted", "tag": "c4b813df-ef3e-473c-a80d-8282f5c9fa39"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:55:14.439803 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-1613dbc5-6297-4fe0-9fbb-e4065864c6b1 req-20193b53-34b2-4a62-af8e-14a99cfce844 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:14.440546 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-1613dbc5-6297-4fe0-9fbb-e4065864c6b1 req-20193b53-34b2-4a62-af8e-14a99cfce844 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:14.441518 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-1613dbc5-6297-4fe0-9fbb-e4065864c6b1 req-20193b53-34b2-4a62-af8e-14a99cfce844 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:14.459646 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-1613dbc5-6297-4fe0-9fbb-e4065864c6b1 req-20193b53-34b2-4a62-af8e-14a99cfce844 service nova] Creating event network-vif-deleted:c4b813df-ef3e-473c-a80d-8282f5c9fa39 for instance 1475417e-aa50-4335-8388-b236aab8881f on hv-cinder-82002 Aug 17 23:55:14.485278 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-1613dbc5-6297-4fe0-9fbb-e4065864c6b1 req-20193b53-34b2-4a62-af8e-14a99cfce844 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059857 Aug 17 23:55:14.486075 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 671/1361] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:55:15.153620 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-5d2821c1-37ac-4bfb-b97c-3002962050f8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:15.154575 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-5d2821c1-37ac-4bfb-b97c-3002962050f8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:15.171945 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5d2821c1-37ac-4bfb-b97c-3002962050f8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:15.172484 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5d2821c1-37ac-4bfb-b97c-3002962050f8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:15.172925 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5d2821c1-37ac-4bfb-b97c-3002962050f8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:15.173821 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5d2821c1-37ac-4bfb-b97c-3002962050f8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:15.174288 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5d2821c1-37ac-4bfb-b97c-3002962050f8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:15.174745 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-5d2821c1-37ac-4bfb-b97c-3002962050f8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:15.196059 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-5d2821c1-37ac-4bfb-b97c-3002962050f8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] HTTP exception thrown: Instance 1475417e-aa50-4335-8388-b236aab8881f could not be found. Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-5d2821c1-37ac-4bfb-b97c-3002962050f8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Request method failure captured: Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f HTTP/1.1 Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X0aZ0Ay-kH6PfvZI7cy17XlPDvVBNqULzMfSd2lBqPeFYOLCW2B4uA7eGgDIh2gyhJRiaquGwrFB0FR_dzBw5dUqMK9aTJoKgjhkCfhyQeKvg5eOtWGiYm8JdFQIhcHvXQSe7gtpzF6F2XNri6JktJopfvlHW5wMD7P-KZBPLA4s0c Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:55:15.197655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:55:15.199810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/258851d93c2d466a85150116d68441b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_258851d93c2d466a85150116d68441b6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:55:15.199810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:15.199810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:55:15.199810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:15.199810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:55:15.199810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:55:15.199810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:55:15.199810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 21e06d9bb5a240459ef3298a990a42f2 Aug 17 23:55:15.199810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:55:15.199810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:55:15.199810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance 1475417e-aa50-4335-8388-b236aab8881f could not be found. Aug 17 23:55:15.199810 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': '1475417e-aa50-4335-8388-b236aab8881f'} Aug 17 23:55:15.201089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:55:15.201089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:15.201089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:55:15.201089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:55:15.201089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:55:15.201089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:55:15.201089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:55:15.201089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:55:15.201089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:55:15.201089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:55:15.201089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1475417e-aa50-4335-8388-b236aab8881f could not be found. Aug 17 23:55:15.201089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:15.201089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:15.201089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:15.201089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:15.201089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:15.201089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:15.201089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:55:15.201089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:55:15.201089 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:55:15.202619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:55:15.202619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:55:15.202619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:55:15.202619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:55:15.202619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:55:15.202619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:55:15.202619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:55:15.202619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1475417e-aa50-4335-8388-b236aab8881f could not be found. Aug 17 23:55:15.202619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:15.202619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:15.202619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:15.202619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:15.202619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:15.202619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:15.202619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:55:15.202619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:55:15.202619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1475417e-aa50-4335-8388-b236aab8881f could not be found. Aug 17 23:55:15.202619 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:15.204309 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-5d2821c1-37ac-4bfb-b97c-3002962050f8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Returning 404 to user: Instance 1475417e-aa50-4335-8388-b236aab8881f could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:55:15.204309 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-5d2821c1-37ac-4bfb-b97c-3002962050f8 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 404 len: 111 microversion: 2.1 time: 0.049555 Aug 17 23:55:15.204309 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 691/1362] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:55:15 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:55:15.212012 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a0915f78-7aaa-427b-9763-375773afdec7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '.version_select at 0x7f85fe29f790>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:15.232332 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a0915f78-7aaa-427b-9763-375773afdec7 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-391688436" status: 202 len: 0 microversion: 2.1 time: 0.025972 Aug 17 23:55:15.233155 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 672/1363] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Aug 17 23:55:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-391688436 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 23:55:15.398217 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-13f2228c-94b3-48e3-88ad-6acb150145fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:15.399001 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-13f2228c-94b3-48e3-88ad-6acb150145fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:15.406771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-13f2228c-94b3-48e3-88ad-6acb150145fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:15.407555 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-13f2228c-94b3-48e3-88ad-6acb150145fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:15.408395 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-13f2228c-94b3-48e3-88ad-6acb150145fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:15.409352 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-13f2228c-94b3-48e3-88ad-6acb150145fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:15.410475 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-13f2228c-94b3-48e3-88ad-6acb150145fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:15.411112 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-13f2228c-94b3-48e3-88ad-6acb150145fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:15.448819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-13f2228c-94b3-48e3-88ad-6acb150145fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] HTTP exception thrown: Instance 011c37dd-ede6-411d-b147-395b6e36ec9d could not be found. Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-13f2228c-94b3-48e3-88ad-6acb150145fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Request method failure captured: Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: DELETE /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d HTTP/1.1 Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X0gZE9JlbYKTrrLiW4VAbW3COer-I9kHd2IqEFzvb3q6K2--HStbtrYSQEwHc0VJYBmCOAMxPH9VaJ2a5Ezse8PxLuEhuMa9MOQzMvq7y53bOiv3GyTjnby9zW3Dzuh1lONZvvKOsoAO5tKYLtmbwRNqtn_SsQmbGPgAPNlHJTeSWo Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: d9574c6bc0ea4f78a0145fc2764a6fa9 Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1876855194 Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:55:15.450788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:55:15.452359 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d9574c6bc0ea4f78a0145fc2764a6fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d9574c6bc0ea4f78a0145fc2764a6fa9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9574c6bc0ea4f78a0145fc2764a6fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9574c6bc0ea4f78a0145fc2764a6fa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:55:15.452359 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1876855194 Aug 17 23:55:15.452359 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: d9574c6bc0ea4f78a0145fc2764a6fa9 Aug 17 23:55:15.452359 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1876855194 Aug 17 23:55:15.452359 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-AttachVolumeShelveTestJSON-1876855194-project Aug 17 23:55:15.452359 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:55:15.452359 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:55:15.452359 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 2da686247e7f490ab7924d0456da60d5 Aug 17 23:55:15.452359 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1876855194-project Aug 17 23:55:15.452359 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:55:15.452359 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance 011c37dd-ede6-411d-b147-395b6e36ec9d could not be found. Aug 17 23:55:15.452359 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': '011c37dd-ede6-411d-b147-395b6e36ec9d'} Aug 17 23:55:15.453159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:55:15.453159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:15.453159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:55:15.453159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:55:15.453159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:55:15.453159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:55:15.453159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:55:15.453159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:55:15.453159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:55:15.453159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:55:15.453159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 011c37dd-ede6-411d-b147-395b6e36ec9d could not be found. Aug 17 23:55:15.453159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:15.453159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:15.453159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:15.453159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:15.453159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:15.453159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:15.453159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:55:15.453159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:55:15.453159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:55:15.454391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:55:15.454391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 23:55:15.454391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 23:55:15.454391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 23:55:15.454391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 23:55:15.454391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:55:15.454391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:55:15.454391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:55:15.454391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:55:15.454391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 011c37dd-ede6-411d-b147-395b6e36ec9d could not be found. Aug 17 23:55:15.454391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:15.454391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:15.454391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:15.454391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:15.454391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:15.454391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:15.454391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:55:15.454391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:55:15.454391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 011c37dd-ede6-411d-b147-395b6e36ec9d could not be found. Aug 17 23:55:15.454391 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:15.457556 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-13f2228c-94b3-48e3-88ad-6acb150145fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Returning 404 to user: Instance 011c37dd-ede6-411d-b147-395b6e36ec9d could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:55:15.457556 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-13f2228c-94b3-48e3-88ad-6acb150145fc tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "DELETE /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 404 len: 111 microversion: 2.20 time: 0.061454 Aug 17 23:55:15.457556 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 692/1364] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Aug 17 23:55:15 2022] DELETE /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 23:55:15.464186 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1277172f-9b39-4719-8089-1868e4d6ed24 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:15.465618 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-1277172f-9b39-4719-8089-1868e4d6ed24 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: 011c37dd-ede6-411d-b147-395b6e36ec9d] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:15.472928 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1277172f-9b39-4719-8089-1868e4d6ed24 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:15.473906 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1277172f-9b39-4719-8089-1868e4d6ed24 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:15.474783 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1277172f-9b39-4719-8089-1868e4d6ed24 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:15.475871 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1277172f-9b39-4719-8089-1868e4d6ed24 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:15.476478 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1277172f-9b39-4719-8089-1868e4d6ed24 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:15.477615 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-1277172f-9b39-4719-8089-1868e4d6ed24 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:15.495780 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-1277172f-9b39-4719-8089-1868e4d6ed24 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] HTTP exception thrown: Instance 011c37dd-ede6-411d-b147-395b6e36ec9d could not be found. Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1277172f-9b39-4719-8089-1868e4d6ed24 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Request method failure captured: Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d HTTP/1.1 Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X0gZE9JlbYKTrrLiW4VAbW3COer-I9kHd2IqEFzvb3q6K2--HStbtrYSQEwHc0VJYBmCOAMxPH9VaJ2a5Ezse8PxLuEhuMa9MOQzMvq7y53bOiv3GyTjnby9zW3Dzuh1lONZvvKOsoAO5tKYLtmbwRNqtn_SsQmbGPgAPNlHJTeSWo Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: d9574c6bc0ea4f78a0145fc2764a6fa9 Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1876855194 Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:55:15.497794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:55:15.499343 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d9574c6bc0ea4f78a0145fc2764a6fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d9574c6bc0ea4f78a0145fc2764a6fa9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9574c6bc0ea4f78a0145fc2764a6fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9574c6bc0ea4f78a0145fc2764a6fa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:55:15.499343 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1876855194 Aug 17 23:55:15.499343 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: d9574c6bc0ea4f78a0145fc2764a6fa9 Aug 17 23:55:15.499343 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1876855194 Aug 17 23:55:15.499343 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-AttachVolumeShelveTestJSON-1876855194-project Aug 17 23:55:15.499343 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:55:15.499343 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:55:15.499343 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 2da686247e7f490ab7924d0456da60d5 Aug 17 23:55:15.499343 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1876855194-project Aug 17 23:55:15.499343 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:55:15.499343 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance 011c37dd-ede6-411d-b147-395b6e36ec9d could not be found. Aug 17 23:55:15.499343 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': '011c37dd-ede6-411d-b147-395b6e36ec9d'} Aug 17 23:55:15.500251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:55:15.500251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:15.500251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:55:15.500251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:55:15.500251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:55:15.500251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:55:15.500251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:55:15.500251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:55:15.500251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:55:15.500251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:55:15.500251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 011c37dd-ede6-411d-b147-395b6e36ec9d could not be found. Aug 17 23:55:15.500251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:15.500251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:15.500251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:15.500251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:15.500251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:15.500251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:15.500251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:55:15.500251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:55:15.500251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:55:15.501487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:55:15.501487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:55:15.501487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:55:15.501487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:55:15.501487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:55:15.501487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:55:15.501487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:55:15.501487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 011c37dd-ede6-411d-b147-395b6e36ec9d could not be found. Aug 17 23:55:15.501487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:15.501487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:15.501487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:15.501487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:15.501487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:15.501487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:15.501487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:55:15.501487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:55:15.501487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 011c37dd-ede6-411d-b147-395b6e36ec9d could not be found. Aug 17 23:55:15.501487 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:15.503874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-1277172f-9b39-4719-8089-1868e4d6ed24 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Returning 404 to user: Instance 011c37dd-ede6-411d-b147-395b6e36ec9d could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:55:15.503874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-1277172f-9b39-4719-8089-1868e4d6ed24 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d" status: 404 len: 111 microversion: 2.20 time: 0.039422 Aug 17 23:55:15.503874 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 673/1365] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:55:15 2022] GET /compute/v2.1/servers/011c37dd-ede6-411d-b147-395b6e36ec9d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 23:55:16.694202 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-6b4a294a-b420-498a-8048-534285d99c66 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:16.694751 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-6b4a294a-b420-498a-8048-534285d99c66 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:16.701154 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6b4a294a-b420-498a-8048-534285d99c66 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:16.701655 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6b4a294a-b420-498a-8048-534285d99c66 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:16.702264 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6b4a294a-b420-498a-8048-534285d99c66 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:16.703305 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6b4a294a-b420-498a-8048-534285d99c66 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:16.703574 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6b4a294a-b420-498a-8048-534285d99c66 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:16.704032 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-6b4a294a-b420-498a-8048-534285d99c66 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:16.717468 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-6b4a294a-b420-498a-8048-534285d99c66 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] HTTP exception thrown: Instance abc34597-7782-4715-86c3-6a940ecde323 could not be found. Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-6b4a294a-b420-498a-8048-534285d99c66 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Request method failure captured: Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: DELETE /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 HTTP/1.1 Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X0gZE9JlbYKTrrLiW4VAbW3COer-I9kHd2IqEFzvb3q6K2--HStbtrYSQEwHc0VJYBmCOAMxPH9VaJ2a5Ezse8PxLuEhuMa9MOQzMvq7y53bOiv3GyTjnby9zW3Dzuh1lONZvvKOsoAO5tKYLtmbwRNqtn_SsQmbGPgAPNlHJTeSWo Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: d9574c6bc0ea4f78a0145fc2764a6fa9 Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1876855194 Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:55:16.719020 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:55:16.720769 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d9574c6bc0ea4f78a0145fc2764a6fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d9574c6bc0ea4f78a0145fc2764a6fa9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9574c6bc0ea4f78a0145fc2764a6fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9574c6bc0ea4f78a0145fc2764a6fa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:55:16.720769 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1876855194 Aug 17 23:55:16.720769 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: d9574c6bc0ea4f78a0145fc2764a6fa9 Aug 17 23:55:16.720769 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1876855194 Aug 17 23:55:16.720769 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-AttachVolumeShelveTestJSON-1876855194-project Aug 17 23:55:16.720769 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:55:16.720769 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:55:16.720769 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 2da686247e7f490ab7924d0456da60d5 Aug 17 23:55:16.720769 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1876855194-project Aug 17 23:55:16.720769 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:55:16.720769 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance abc34597-7782-4715-86c3-6a940ecde323 could not be found. Aug 17 23:55:16.720769 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': 'abc34597-7782-4715-86c3-6a940ecde323'} Aug 17 23:55:16.721648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:55:16.721648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:16.721648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:55:16.721648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:55:16.721648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:55:16.721648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:55:16.721648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:55:16.721648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:55:16.721648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:55:16.721648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:55:16.721648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abc34597-7782-4715-86c3-6a940ecde323 could not be found. Aug 17 23:55:16.721648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:16.721648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:16.721648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:16.721648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:16.721648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:16.721648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:16.721648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:55:16.721648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:55:16.721648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:55:16.723491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:55:16.723491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 23:55:16.723491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 23:55:16.723491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 23:55:16.723491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 23:55:16.723491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:55:16.723491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:55:16.723491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:55:16.723491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:55:16.723491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abc34597-7782-4715-86c3-6a940ecde323 could not be found. Aug 17 23:55:16.723491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:16.723491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:16.723491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:16.723491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:16.723491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:16.723491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:16.723491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:55:16.723491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:55:16.723491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abc34597-7782-4715-86c3-6a940ecde323 could not be found. Aug 17 23:55:16.723491 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:16.725535 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-6b4a294a-b420-498a-8048-534285d99c66 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Returning 404 to user: Instance abc34597-7782-4715-86c3-6a940ecde323 could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:55:16.725535 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-6b4a294a-b420-498a-8048-534285d99c66 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "DELETE /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 404 len: 111 microversion: 2.20 time: 0.030145 Aug 17 23:55:16.725535 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 693/1366] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Aug 17 23:55:16 2022] DELETE /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 23:55:16.732406 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-028e557c-8d09-4958-93f4-72c3103f9286 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:16.733101 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-028e557c-8d09-4958-93f4-72c3103f9286 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] [instance: abc34597-7782-4715-86c3-6a940ecde323] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:16.740584 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-028e557c-8d09-4958-93f4-72c3103f9286 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:16.741137 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-028e557c-8d09-4958-93f4-72c3103f9286 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:16.741587 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-028e557c-8d09-4958-93f4-72c3103f9286 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:16.742483 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-028e557c-8d09-4958-93f4-72c3103f9286 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:16.742939 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-028e557c-8d09-4958-93f4-72c3103f9286 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:16.743361 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-028e557c-8d09-4958-93f4-72c3103f9286 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:16.758887 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-028e557c-8d09-4958-93f4-72c3103f9286 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] HTTP exception thrown: Instance abc34597-7782-4715-86c3-6a940ecde323 could not be found. Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-028e557c-8d09-4958-93f4-72c3103f9286 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Request method failure captured: Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 HTTP/1.1 Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X0gZE9JlbYKTrrLiW4VAbW3COer-I9kHd2IqEFzvb3q6K2--HStbtrYSQEwHc0VJYBmCOAMxPH9VaJ2a5Ezse8PxLuEhuMa9MOQzMvq7y53bOiv3GyTjnby9zW3Dzuh1lONZvvKOsoAO5tKYLtmbwRNqtn_SsQmbGPgAPNlHJTeSWo Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: d9574c6bc0ea4f78a0145fc2764a6fa9 Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1876855194 Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:55:16.760713 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:55:16.762441 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d9574c6bc0ea4f78a0145fc2764a6fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d9574c6bc0ea4f78a0145fc2764a6fa9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9574c6bc0ea4f78a0145fc2764a6fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9574c6bc0ea4f78a0145fc2764a6fa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:55:16.762441 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1876855194 Aug 17 23:55:16.762441 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: d9574c6bc0ea4f78a0145fc2764a6fa9 Aug 17 23:55:16.762441 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1876855194 Aug 17 23:55:16.762441 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-AttachVolumeShelveTestJSON-1876855194-project Aug 17 23:55:16.762441 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:55:16.762441 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:55:16.762441 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 2da686247e7f490ab7924d0456da60d5 Aug 17 23:55:16.762441 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1876855194-project Aug 17 23:55:16.762441 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:55:16.762441 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance abc34597-7782-4715-86c3-6a940ecde323 could not be found. Aug 17 23:55:16.762441 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': 'abc34597-7782-4715-86c3-6a940ecde323'} Aug 17 23:55:16.763360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:55:16.763360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:16.763360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:55:16.763360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:55:16.763360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:55:16.763360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:55:16.763360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:55:16.763360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:55:16.763360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:55:16.763360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:55:16.763360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abc34597-7782-4715-86c3-6a940ecde323 could not be found. Aug 17 23:55:16.763360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:16.763360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:16.763360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:16.763360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:16.763360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:16.763360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:16.763360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:55:16.763360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:55:16.763360 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:55:16.764895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:55:16.764895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:55:16.764895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:55:16.764895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:55:16.764895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:55:16.764895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:55:16.764895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:55:16.764895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abc34597-7782-4715-86c3-6a940ecde323 could not be found. Aug 17 23:55:16.764895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:16.764895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:16.764895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:16.764895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:16.764895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:16.764895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:16.764895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:55:16.764895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:55:16.764895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abc34597-7782-4715-86c3-6a940ecde323 could not be found. Aug 17 23:55:16.764895 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:16.766235 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-028e557c-8d09-4958-93f4-72c3103f9286 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] Returning 404 to user: Instance abc34597-7782-4715-86c3-6a940ecde323 could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:55:16.766235 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-028e557c-8d09-4958-93f4-72c3103f9286 tempest-AttachVolumeShelveTestJSON-1876855194 tempest-AttachVolumeShelveTestJSON-1876855194-project] 10.222.0.26 "GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323" status: 404 len: 111 microversion: 2.20 time: 0.033804 Aug 17 23:55:16.766235 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 674/1367] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Aug 17 23:55:16 2022] GET /compute/v2.1/servers/abc34597-7782-4715-86c3-6a940ecde323 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 17 23:55:17.135190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9dbce4b2-085e-42b7-9314-26dd76ea1733 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:17.135690 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9dbce4b2-085e-42b7-9314-26dd76ea1733 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:17.141791 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9dbce4b2-085e-42b7-9314-26dd76ea1733 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:17.142320 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9dbce4b2-085e-42b7-9314-26dd76ea1733 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:17.142758 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9dbce4b2-085e-42b7-9314-26dd76ea1733 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:17.143446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9dbce4b2-085e-42b7-9314-26dd76ea1733 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:17.144057 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9dbce4b2-085e-42b7-9314-26dd76ea1733 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:17.144404 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9dbce4b2-085e-42b7-9314-26dd76ea1733 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:17.157994 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-9dbce4b2-085e-42b7-9314-26dd76ea1733 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] HTTP exception thrown: Instance 1475417e-aa50-4335-8388-b236aab8881f could not be found. Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9dbce4b2-085e-42b7-9314-26dd76ea1733 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Request method failure captured: Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: DELETE /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f HTTP/1.1 Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X0aZ0Ay-kH6PfvZI7cy17XlPDvVBNqULzMfSd2lBqPeFYOLCW2B4uA7eGgDIh2gyhJRiaquGwrFB0FR_dzBw5dUqMK9aTJoKgjhkCfhyQeKvg5eOtWGiYm8JdFQIhcHvXQSe7gtpzF6F2XNri6JktJopfvlHW5wMD7P-KZBPLA4s0c Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:55:17.160135 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:55:17.161768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/258851d93c2d466a85150116d68441b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_258851d93c2d466a85150116d68441b6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:55:17.161768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:17.161768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:55:17.161768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:17.161768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:55:17.161768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:55:17.161768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:55:17.161768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 21e06d9bb5a240459ef3298a990a42f2 Aug 17 23:55:17.161768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:55:17.161768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:55:17.161768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance 1475417e-aa50-4335-8388-b236aab8881f could not be found. Aug 17 23:55:17.161768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': '1475417e-aa50-4335-8388-b236aab8881f'} Aug 17 23:55:17.162633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:55:17.162633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:17.162633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:55:17.162633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:55:17.162633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:55:17.162633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:55:17.162633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:55:17.162633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:55:17.162633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:55:17.162633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:55:17.162633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1475417e-aa50-4335-8388-b236aab8881f could not be found. Aug 17 23:55:17.162633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:17.162633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:17.162633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:17.162633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:17.162633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:17.162633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:17.162633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:55:17.162633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:55:17.162633 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:55:17.163880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:55:17.163880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 23:55:17.163880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 23:55:17.163880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 23:55:17.163880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 23:55:17.163880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:55:17.163880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:55:17.163880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:55:17.163880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:55:17.163880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1475417e-aa50-4335-8388-b236aab8881f could not be found. Aug 17 23:55:17.163880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:17.163880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:17.163880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:17.163880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:17.163880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:17.163880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:17.163880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:55:17.163880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:55:17.163880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1475417e-aa50-4335-8388-b236aab8881f could not be found. Aug 17 23:55:17.163880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:17.165153 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9dbce4b2-085e-42b7-9314-26dd76ea1733 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Returning 404 to user: Instance 1475417e-aa50-4335-8388-b236aab8881f could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:55:17.165153 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9dbce4b2-085e-42b7-9314-26dd76ea1733 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 404 len: 111 microversion: 2.1 time: 0.030176 Aug 17 23:55:17.165153 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 694/1368] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:55:17 2022] DELETE /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:55:17.170517 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-cb63269d-cdfa-4d60-8b0a-704ff0bcb5dd tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:17.171154 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-cb63269d-cdfa-4d60-8b0a-704ff0bcb5dd tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: 1475417e-aa50-4335-8388-b236aab8881f] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:17.180314 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cb63269d-cdfa-4d60-8b0a-704ff0bcb5dd tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:17.180948 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cb63269d-cdfa-4d60-8b0a-704ff0bcb5dd tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:17.181411 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cb63269d-cdfa-4d60-8b0a-704ff0bcb5dd tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:17.182119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cb63269d-cdfa-4d60-8b0a-704ff0bcb5dd tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:17.182577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cb63269d-cdfa-4d60-8b0a-704ff0bcb5dd tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:17.183008 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cb63269d-cdfa-4d60-8b0a-704ff0bcb5dd tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:17.198068 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-cb63269d-cdfa-4d60-8b0a-704ff0bcb5dd tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] HTTP exception thrown: Instance 1475417e-aa50-4335-8388-b236aab8881f could not be found. Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-cb63269d-cdfa-4d60-8b0a-704ff0bcb5dd tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Request method failure captured: Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f HTTP/1.1 Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X0aZ0Ay-kH6PfvZI7cy17XlPDvVBNqULzMfSd2lBqPeFYOLCW2B4uA7eGgDIh2gyhJRiaquGwrFB0FR_dzBw5dUqMK9aTJoKgjhkCfhyQeKvg5eOtWGiYm8JdFQIhcHvXQSe7gtpzF6F2XNri6JktJopfvlHW5wMD7P-KZBPLA4s0c Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:55:17.199658 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:55:17.201182 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/258851d93c2d466a85150116d68441b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_258851d93c2d466a85150116d68441b6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:55:17.201182 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:17.201182 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:55:17.201182 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:17.201182 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:55:17.201182 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:55:17.201182 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:55:17.201182 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 21e06d9bb5a240459ef3298a990a42f2 Aug 17 23:55:17.201182 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:55:17.201182 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:55:17.201182 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance 1475417e-aa50-4335-8388-b236aab8881f could not be found. Aug 17 23:55:17.201182 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': '1475417e-aa50-4335-8388-b236aab8881f'} Aug 17 23:55:17.202085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:55:17.202085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:17.202085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:55:17.202085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:55:17.202085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:55:17.202085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:55:17.202085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:55:17.202085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:55:17.202085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:55:17.202085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:55:17.202085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1475417e-aa50-4335-8388-b236aab8881f could not be found. Aug 17 23:55:17.202085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:17.202085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:17.202085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:17.202085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:17.202085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:17.202085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:17.202085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:55:17.202085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:55:17.202085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:55:17.206671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:55:17.206671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:55:17.206671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:55:17.206671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:55:17.206671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:55:17.206671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:55:17.206671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:55:17.206671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1475417e-aa50-4335-8388-b236aab8881f could not be found. Aug 17 23:55:17.206671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:17.206671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:17.206671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:17.206671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:17.206671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:17.206671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:17.206671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:55:17.206671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:55:17.206671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1475417e-aa50-4335-8388-b236aab8881f could not be found. Aug 17 23:55:17.206671 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:17.208084 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-cb63269d-cdfa-4d60-8b0a-704ff0bcb5dd tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Returning 404 to user: Instance 1475417e-aa50-4335-8388-b236aab8881f could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:55:17.208084 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-cb63269d-cdfa-4d60-8b0a-704ff0bcb5dd tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f" status: 404 len: 111 microversion: 2.1 time: 0.035598 Aug 17 23:55:17.208084 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 675/1369] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:55:17 2022] GET /compute/v2.1/servers/1475417e-aa50-4335-8388-b236aab8881f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:55:18.387044 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-fa6a71da-5c46-4598-88c2-4dfc34970597 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:18.387590 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-fa6a71da-5c46-4598-88c2-4dfc34970597 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:18.394560 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa6a71da-5c46-4598-88c2-4dfc34970597 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:18.395046 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa6a71da-5c46-4598-88c2-4dfc34970597 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:18.395492 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa6a71da-5c46-4598-88c2-4dfc34970597 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:18.396221 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa6a71da-5c46-4598-88c2-4dfc34970597 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:18.396677 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa6a71da-5c46-4598-88c2-4dfc34970597 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:18.397103 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-fa6a71da-5c46-4598-88c2-4dfc34970597 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:18.410786 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-fa6a71da-5c46-4598-88c2-4dfc34970597 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] HTTP exception thrown: Instance c039ab07-eda9-4a13-8fd1-faee03623668 could not be found. Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-fa6a71da-5c46-4598-88c2-4dfc34970597 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Request method failure captured: Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: DELETE /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 HTTP/1.1 Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X0aZ0Ay-kH6PfvZI7cy17XlPDvVBNqULzMfSd2lBqPeFYOLCW2B4uA7eGgDIh2gyhJRiaquGwrFB0FR_dzBw5dUqMK9aTJoKgjhkCfhyQeKvg5eOtWGiYm8JdFQIhcHvXQSe7gtpzF6F2XNri6JktJopfvlHW5wMD7P-KZBPLA4s0c Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:55:18.412364 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:55:18.414118 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/258851d93c2d466a85150116d68441b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_258851d93c2d466a85150116d68441b6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:55:18.414118 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:18.414118 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:55:18.414118 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:18.414118 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:55:18.414118 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:55:18.414118 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:55:18.414118 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 21e06d9bb5a240459ef3298a990a42f2 Aug 17 23:55:18.414118 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:55:18.414118 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:55:18.414118 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance c039ab07-eda9-4a13-8fd1-faee03623668 could not be found. Aug 17 23:55:18.414118 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': 'c039ab07-eda9-4a13-8fd1-faee03623668'} Aug 17 23:55:18.415207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:55:18.415207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:18.415207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:55:18.415207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:55:18.415207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:55:18.415207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:55:18.415207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:55:18.415207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:55:18.415207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:55:18.415207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:55:18.415207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c039ab07-eda9-4a13-8fd1-faee03623668 could not be found. Aug 17 23:55:18.415207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:18.415207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:18.415207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:18.415207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:18.415207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:18.415207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:18.415207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:55:18.415207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:55:18.415207 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:55:18.416805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:55:18.416805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 23:55:18.416805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 23:55:18.416805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 23:55:18.416805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 23:55:18.416805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:55:18.416805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:55:18.416805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:55:18.416805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:55:18.416805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c039ab07-eda9-4a13-8fd1-faee03623668 could not be found. Aug 17 23:55:18.416805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:18.416805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:18.416805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:18.416805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:18.416805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:18.416805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:18.416805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:55:18.416805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:55:18.416805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c039ab07-eda9-4a13-8fd1-faee03623668 could not be found. Aug 17 23:55:18.416805 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:18.419024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-fa6a71da-5c46-4598-88c2-4dfc34970597 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Returning 404 to user: Instance c039ab07-eda9-4a13-8fd1-faee03623668 could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:55:18.419024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-fa6a71da-5c46-4598-88c2-4dfc34970597 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 404 len: 111 microversion: 2.1 time: 0.030973 Aug 17 23:55:18.419024 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 695/1370] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:55:18 2022] DELETE /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:55:18.424605 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0c35fcc9-e306-4964-9f99-ec5aa8b2c638 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:18.425732 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-0c35fcc9-e306-4964-9f99-ec5aa8b2c638 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: c039ab07-eda9-4a13-8fd1-faee03623668] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:18.431883 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0c35fcc9-e306-4964-9f99-ec5aa8b2c638 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:18.432446 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0c35fcc9-e306-4964-9f99-ec5aa8b2c638 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:18.432885 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0c35fcc9-e306-4964-9f99-ec5aa8b2c638 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:18.433578 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0c35fcc9-e306-4964-9f99-ec5aa8b2c638 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:18.434045 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0c35fcc9-e306-4964-9f99-ec5aa8b2c638 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:18.434699 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-0c35fcc9-e306-4964-9f99-ec5aa8b2c638 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:18.450337 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-0c35fcc9-e306-4964-9f99-ec5aa8b2c638 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] HTTP exception thrown: Instance c039ab07-eda9-4a13-8fd1-faee03623668 could not be found. Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0c35fcc9-e306-4964-9f99-ec5aa8b2c638 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Request method failure captured: Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 HTTP/1.1 Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X0aZ0Ay-kH6PfvZI7cy17XlPDvVBNqULzMfSd2lBqPeFYOLCW2B4uA7eGgDIh2gyhJRiaquGwrFB0FR_dzBw5dUqMK9aTJoKgjhkCfhyQeKvg5eOtWGiYm8JdFQIhcHvXQSe7gtpzF6F2XNri6JktJopfvlHW5wMD7P-KZBPLA4s0c Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:55:18.451935 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:55:18.453753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/258851d93c2d466a85150116d68441b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_258851d93c2d466a85150116d68441b6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:55:18.453753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:18.453753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:55:18.453753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:18.453753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:55:18.453753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:55:18.453753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:55:18.453753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 21e06d9bb5a240459ef3298a990a42f2 Aug 17 23:55:18.453753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:55:18.453753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:55:18.453753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance c039ab07-eda9-4a13-8fd1-faee03623668 could not be found. Aug 17 23:55:18.453753 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': 'c039ab07-eda9-4a13-8fd1-faee03623668'} Aug 17 23:55:18.457889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:55:18.457889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:18.457889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:55:18.457889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:55:18.457889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:55:18.457889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:55:18.457889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:55:18.457889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:55:18.457889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:55:18.457889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:55:18.457889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c039ab07-eda9-4a13-8fd1-faee03623668 could not be found. Aug 17 23:55:18.457889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:18.457889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:18.457889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:18.457889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:18.457889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:18.457889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:18.457889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:55:18.457889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:55:18.457889 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:55:18.459421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:55:18.459421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:55:18.459421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:55:18.459421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:55:18.459421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:55:18.459421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:55:18.459421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:55:18.459421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c039ab07-eda9-4a13-8fd1-faee03623668 could not be found. Aug 17 23:55:18.459421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:18.459421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:18.459421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:18.459421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:18.459421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:18.459421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:18.459421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:55:18.459421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:55:18.459421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c039ab07-eda9-4a13-8fd1-faee03623668 could not be found. Aug 17 23:55:18.459421 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:18.460594 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-0c35fcc9-e306-4964-9f99-ec5aa8b2c638 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Returning 404 to user: Instance c039ab07-eda9-4a13-8fd1-faee03623668 could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:55:18.460594 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-0c35fcc9-e306-4964-9f99-ec5aa8b2c638 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668" status: 404 len: 111 microversion: 2.1 time: 0.033047 Aug 17 23:55:18.460594 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 676/1371] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:55:18 2022] GET /compute/v2.1/servers/c039ab07-eda9-4a13-8fd1-faee03623668 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:55:18.462139 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-08941532-8c3b-44dd-9d62-5ccbffe8dc1e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:18.462639 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-08941532-8c3b-44dd-9d62-5ccbffe8dc1e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:18.468724 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08941532-8c3b-44dd-9d62-5ccbffe8dc1e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:18.469208 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08941532-8c3b-44dd-9d62-5ccbffe8dc1e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:18.469645 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08941532-8c3b-44dd-9d62-5ccbffe8dc1e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:18.470335 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08941532-8c3b-44dd-9d62-5ccbffe8dc1e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:18.470788 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08941532-8c3b-44dd-9d62-5ccbffe8dc1e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:18.471210 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-08941532-8c3b-44dd-9d62-5ccbffe8dc1e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:18.484819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-08941532-8c3b-44dd-9d62-5ccbffe8dc1e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] HTTP exception thrown: Instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 could not be found. Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-08941532-8c3b-44dd-9d62-5ccbffe8dc1e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Request method failure captured: Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: DELETE /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 HTTP/1.1 Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X0aZ0Ay-kH6PfvZI7cy17XlPDvVBNqULzMfSd2lBqPeFYOLCW2B4uA7eGgDIh2gyhJRiaquGwrFB0FR_dzBw5dUqMK9aTJoKgjhkCfhyQeKvg5eOtWGiYm8JdFQIhcHvXQSe7gtpzF6F2XNri6JktJopfvlHW5wMD7P-KZBPLA4s0c Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:55:18.486373 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:55:18.492096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/258851d93c2d466a85150116d68441b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_258851d93c2d466a85150116d68441b6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:55:18.492096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:18.492096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:55:18.492096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:18.492096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:55:18.492096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:55:18.492096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:55:18.492096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 21e06d9bb5a240459ef3298a990a42f2 Aug 17 23:55:18.492096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:55:18.492096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:55:18.492096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 could not be found. Aug 17 23:55:18.492096 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': 'a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3'} Aug 17 23:55:18.493085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:55:18.493085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:18.493085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:55:18.493085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:55:18.493085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:55:18.493085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:55:18.493085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:55:18.493085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:55:18.493085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:55:18.493085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:55:18.493085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 could not be found. Aug 17 23:55:18.493085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:18.493085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:18.493085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:18.493085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:18.493085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:18.493085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:18.493085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:55:18.493085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:55:18.493085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:55:18.494538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:55:18.494538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 23:55:18.494538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 23:55:18.494538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 23:55:18.494538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 23:55:18.494538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:55:18.494538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:55:18.494538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:55:18.494538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:55:18.494538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 could not be found. Aug 17 23:55:18.494538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:18.494538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:18.494538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:18.494538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:18.494538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:18.494538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:18.494538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:55:18.494538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:55:18.494538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 could not be found. Aug 17 23:55:18.494538 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:18.495999 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-08941532-8c3b-44dd-9d62-5ccbffe8dc1e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Returning 404 to user: Instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:55:18.495999 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-08941532-8c3b-44dd-9d62-5ccbffe8dc1e tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 404 len: 111 microversion: 2.1 time: 0.029577 Aug 17 23:55:18.495999 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 696/1372] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:55:18 2022] DELETE /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 23:55:18.500750 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ca88c5f6-24c9-4a81-8240-6d7617f36b57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:18.501472 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-ca88c5f6-24c9-4a81-8240-6d7617f36b57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:18.508871 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ca88c5f6-24c9-4a81-8240-6d7617f36b57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:18.509475 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ca88c5f6-24c9-4a81-8240-6d7617f36b57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:18.510085 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ca88c5f6-24c9-4a81-8240-6d7617f36b57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:18.510855 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ca88c5f6-24c9-4a81-8240-6d7617f36b57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:18.511379 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ca88c5f6-24c9-4a81-8240-6d7617f36b57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:18.511875 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-ca88c5f6-24c9-4a81-8240-6d7617f36b57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:18.527227 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-ca88c5f6-24c9-4a81-8240-6d7617f36b57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] HTTP exception thrown: Instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 could not be found. Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ca88c5f6-24c9-4a81-8240-6d7617f36b57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Request method failure captured: Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 HTTP/1.1 Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X0aZ0Ay-kH6PfvZI7cy17XlPDvVBNqULzMfSd2lBqPeFYOLCW2B4uA7eGgDIh2gyhJRiaquGwrFB0FR_dzBw5dUqMK9aTJoKgjhkCfhyQeKvg5eOtWGiYm8JdFQIhcHvXQSe7gtpzF6F2XNri6JktJopfvlHW5wMD7P-KZBPLA4s0c Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:55:18.529052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:55:18.530637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/258851d93c2d466a85150116d68441b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_258851d93c2d466a85150116d68441b6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:55:18.530637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:18.530637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:55:18.530637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:18.530637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:55:18.530637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:55:18.530637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:55:18.530637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 21e06d9bb5a240459ef3298a990a42f2 Aug 17 23:55:18.530637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:55:18.530637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:55:18.530637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 could not be found. Aug 17 23:55:18.530637 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': 'a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3'} Aug 17 23:55:18.531515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:55:18.531515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:18.531515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:55:18.531515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:55:18.531515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:55:18.531515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:55:18.531515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:55:18.531515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:55:18.531515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:55:18.531515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:55:18.531515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 could not be found. Aug 17 23:55:18.531515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:18.531515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:18.531515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:18.531515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:18.531515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:18.531515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:18.531515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:55:18.531515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:55:18.531515 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:55:18.533120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:55:18.533120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:55:18.533120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:55:18.533120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:55:18.533120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:55:18.533120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:55:18.533120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:55:18.533120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 could not be found. Aug 17 23:55:18.533120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:18.533120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:18.533120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:18.533120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:18.533120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:18.533120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:18.533120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:55:18.533120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:55:18.533120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 could not be found. Aug 17 23:55:18.533120 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:18.537710 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ca88c5f6-24c9-4a81-8240-6d7617f36b57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Returning 404 to user: Instance a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:55:18.537710 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ca88c5f6-24c9-4a81-8240-6d7617f36b57 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3" status: 404 len: 111 microversion: 2.1 time: 0.036174 Aug 17 23:55:18.537710 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 677/1373] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:55:18 2022] GET /compute/v2.1/servers/a7eaefb1-3e09-48fe-85a2-2872d2e7cdd3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:55:19.682022 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-18b8dbe1-44f3-4852-8112-cc249883d179 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:19.682577 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-18b8dbe1-44f3-4852-8112-cc249883d179 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:19.691919 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-18b8dbe1-44f3-4852-8112-cc249883d179 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:19.692638 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-18b8dbe1-44f3-4852-8112-cc249883d179 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:19.693229 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-18b8dbe1-44f3-4852-8112-cc249883d179 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:19.694214 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-18b8dbe1-44f3-4852-8112-cc249883d179 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:19.694833 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-18b8dbe1-44f3-4852-8112-cc249883d179 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:19.695578 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-18b8dbe1-44f3-4852-8112-cc249883d179 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:19.714695 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-18b8dbe1-44f3-4852-8112-cc249883d179 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] HTTP exception thrown: Instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 could not be found. Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-18b8dbe1-44f3-4852-8112-cc249883d179 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Request method failure captured: Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: DELETE /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 HTTP/1.1 Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X0aZ0Ay-kH6PfvZI7cy17XlPDvVBNqULzMfSd2lBqPeFYOLCW2B4uA7eGgDIh2gyhJRiaquGwrFB0FR_dzBw5dUqMK9aTJoKgjhkCfhyQeKvg5eOtWGiYm8JdFQIhcHvXQSe7gtpzF6F2XNri6JktJopfvlHW5wMD7P-KZBPLA4s0c Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:55:19.716479 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:55:19.718085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/258851d93c2d466a85150116d68441b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_258851d93c2d466a85150116d68441b6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:55:19.718085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:19.718085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:55:19.718085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:19.718085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:55:19.718085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:55:19.718085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:55:19.718085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 21e06d9bb5a240459ef3298a990a42f2 Aug 17 23:55:19.718085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:55:19.718085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:55:19.718085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 could not be found. Aug 17 23:55:19.718085 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': 'd619bf9d-15c1-4cef-bcc3-4a792878bf73'} Aug 17 23:55:19.718995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:55:19.718995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:19.718995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:55:19.718995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:55:19.718995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:55:19.718995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:55:19.718995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:55:19.718995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:55:19.718995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:55:19.718995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:55:19.718995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 could not be found. Aug 17 23:55:19.718995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:19.718995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:19.718995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:19.718995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:19.718995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:19.718995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:19.718995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:55:19.718995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:55:19.718995 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:55:19.720547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:55:19.720547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 23:55:19.720547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 23:55:19.720547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 23:55:19.720547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 23:55:19.720547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:55:19.720547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:55:19.720547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:55:19.720547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:55:19.720547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 could not be found. Aug 17 23:55:19.720547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:19.720547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:19.720547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:19.720547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:19.720547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:19.720547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:19.720547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:55:19.720547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:55:19.720547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 could not be found. Aug 17 23:55:19.720547 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:19.722293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-18b8dbe1-44f3-4852-8112-cc249883d179 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Returning 404 to user: Instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:55:19.722293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-18b8dbe1-44f3-4852-8112-cc249883d179 tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 404 len: 111 microversion: 2.1 time: 0.041422 Aug 17 23:55:19.722293 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 697/1374] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:55:19 2022] DELETE /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:55:19.727853 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-783b7d80-18db-44ff-87e7-48537c05958b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:19.728603 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-783b7d80-18db-44ff-87e7-48537c05958b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] [instance: d619bf9d-15c1-4cef-bcc3-4a792878bf73] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:55:19.735855 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-783b7d80-18db-44ff-87e7-48537c05958b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:19.736452 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-783b7d80-18db-44ff-87e7-48537c05958b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:19.736970 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-783b7d80-18db-44ff-87e7-48537c05958b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:19.737787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-783b7d80-18db-44ff-87e7-48537c05958b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:55:19.738316 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-783b7d80-18db-44ff-87e7-48537c05958b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:55:19.738801 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-783b7d80-18db-44ff-87e7-48537c05958b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:55:19.756578 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-783b7d80-18db-44ff-87e7-48537c05958b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] HTTP exception thrown: Instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 could not be found. Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-783b7d80-18db-44ff-87e7-48537c05958b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Request method failure captured: Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 HTTP/1.1 Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X0aZ0Ay-kH6PfvZI7cy17XlPDvVBNqULzMfSd2lBqPeFYOLCW2B4uA7eGgDIh2gyhJRiaquGwrFB0FR_dzBw5dUqMK9aTJoKgjhkCfhyQeKvg5eOtWGiYm8JdFQIhcHvXQSe7gtpzF6F2XNri6JktJopfvlHW5wMD7P-KZBPLA4s0c Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:55:19.758905 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:55:19.760435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/258851d93c2d466a85150116d68441b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_258851d93c2d466a85150116d68441b6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/258851d93c2d466a85150116d68441b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:55:19.760435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:19.760435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: 258851d93c2d466a85150116d68441b6 Aug 17 23:55:19.760435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1145259794 Aug 17 23:55:19.760435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:55:19.760435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:55:19.760435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:55:19.760435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 21e06d9bb5a240459ef3298a990a42f2 Aug 17 23:55:19.760435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-AttachVolumeNegativeTest-1145259794-project Aug 17 23:55:19.760435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:55:19.760435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 could not be found. Aug 17 23:55:19.760435 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': 'd619bf9d-15c1-4cef-bcc3-4a792878bf73'} Aug 17 23:55:19.761375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:55:19.761375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:19.761375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:55:19.761375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:55:19.761375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:55:19.761375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:55:19.761375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:55:19.761375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:55:19.761375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:55:19.761375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:55:19.761375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 could not be found. Aug 17 23:55:19.761375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:19.761375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:19.761375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:19.761375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:19.761375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:19.761375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:19.761375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:55:19.761375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:55:19.761375 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:55:19.762960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:55:19.762960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:55:19.762960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:55:19.762960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:55:19.762960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:55:19.762960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:55:19.762960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:55:19.762960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 could not be found. Aug 17 23:55:19.762960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:19.762960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:19.762960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:19.762960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:19.762960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:19.762960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:19.762960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:55:19.762960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:55:19.762960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 could not be found. Aug 17 23:55:19.762960 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:19.765031 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-783b7d80-18db-44ff-87e7-48537c05958b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] Returning 404 to user: Instance d619bf9d-15c1-4cef-bcc3-4a792878bf73 could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:55:19.765031 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-783b7d80-18db-44ff-87e7-48537c05958b tempest-AttachVolumeNegativeTest-1145259794 tempest-AttachVolumeNegativeTest-1145259794-project] 10.222.0.26 "GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73" status: 404 len: 111 microversion: 2.1 time: 0.039451 Aug 17 23:55:19.767876 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 678/1375] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:55:19 2022] GET /compute/v2.1/servers/d619bf9d-15c1-4cef-bcc3-4a792878bf73 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:55:22.669446 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e503e803-bde4-41cd-92e8-eab95f02d713 tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] Action: 'create', calling method: .version_select at 0x7f85fdb64160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1726043239", "metadata": {"Type": "work"}}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e503e803-bde4-41cd-92e8-eab95f02d713 tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] Request method failure captured: Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 122 Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X_qoWiozLqGukes3jqj-6fDHwN66nIb4hBHX795_fwgIQzQx3262hbLRstjMlPDq2xsYmjp6Ug6EqSpdQ9CMc48dm4fibqGsYXkbOZgXJ82gfZUQCSxEIgzeEehx9occk6gWwwlnkcKPLadkuIGG77f-VpiJovJkw689SOWoQpXCBE Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: 3e9796a76d0846aebbad8db721bbca45 Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-VolumesNegativeTest-1722847964 Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:55:22.690984 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:55:22.692661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3e9796a76d0846aebbad8db721bbca45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3e9796a76d0846aebbad8db721bbca45", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e9796a76d0846aebbad8db721bbca45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e9796a76d0846aebbad8db721bbca45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:55:22.692661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-VolumesNegativeTest-1722847964 Aug 17 23:55:22.692661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: 3e9796a76d0846aebbad8db721bbca45 Aug 17 23:55:22.692661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-VolumesNegativeTest-1722847964 Aug 17 23:55:22.692661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-VolumesNegativeTest-1722847964-project Aug 17 23:55:22.692661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:55:22.692661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:55:22.692661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 49de8489be8048a0b52167d12ab05f8b Aug 17 23:55:22.692661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-VolumesNegativeTest-1722847964-project Aug 17 23:55:22.692661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Aug 17 23:55:22.692661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1726043239", "metadata": {"Type": "work"}}} Aug 17 23:55:22.692661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: Aug 17 23:55:22.692661 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1726043239', 'metadata': {'Type': 'work'}}}} Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise error Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi '#$%' Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:55:22.693561 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:55:22.694998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 23:55:22.694998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 23:55:22.694998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:55:22.694998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:55:22.694998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 23:55:22.694998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 23:55:22.694998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 23:55:22.694998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 23:55:22.694998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 23:55:22.694998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 23:55:22.694998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 23:55:22.694998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.694998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:22.694998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.694998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.694998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:22.694998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:22.694998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 23:55:22.694998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 23:55:22.697092 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 23:55:22.697092 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.698397 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e503e803-bde4-41cd-92e8-eab95f02d713 tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:55:22.699584 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e503e803-bde4-41cd-92e8-eab95f02d713 tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.177448 Aug 17 23:55:22.700514 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 698/1376] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Aug 17 23:55:22 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 23:55:22.711175 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-39be6255-a178-4431-a6b0-0dbf83321bcb tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] Action: 'create', calling method: .version_select at 0x7f85fda7e160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1721620337", "metadata": {"Type": "work"}}} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-39be6255-a178-4431-a6b0-0dbf83321bcb tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] Request method failure captured: Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 120 Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X_qoWiozLqGukes3jqj-6fDHwN66nIb4hBHX795_fwgIQzQx3262hbLRstjMlPDq2xsYmjp6Ug6EqSpdQ9CMc48dm4fibqGsYXkbOZgXJ82gfZUQCSxEIgzeEehx9occk6gWwwlnkcKPLadkuIGG77f-VpiJovJkw689SOWoQpXCBE Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: 3e9796a76d0846aebbad8db721bbca45 Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-VolumesNegativeTest-1722847964 Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:55:22.717896 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:55:22.719440 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3e9796a76d0846aebbad8db721bbca45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3e9796a76d0846aebbad8db721bbca45", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e9796a76d0846aebbad8db721bbca45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e9796a76d0846aebbad8db721bbca45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:55:22.719440 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-VolumesNegativeTest-1722847964 Aug 17 23:55:22.719440 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: 3e9796a76d0846aebbad8db721bbca45 Aug 17 23:55:22.719440 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-VolumesNegativeTest-1722847964 Aug 17 23:55:22.719440 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-VolumesNegativeTest-1722847964-project Aug 17 23:55:22.719440 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:55:22.719440 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:55:22.719440 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 49de8489be8048a0b52167d12ab05f8b Aug 17 23:55:22.719440 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-VolumesNegativeTest-1722847964-project Aug 17 23:55:22.719440 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Aug 17 23:55:22.719440 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1721620337", "metadata": {"Type": "work"}}} Aug 17 23:55:22.719440 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: Aug 17 23:55:22.719440 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1721620337', 'metadata': {'Type': 'work'}}}} Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise error Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi '0' Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:55:22.720429 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:55:22.721829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 23:55:22.721829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 23:55:22.721829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:55:22.721829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:55:22.721829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 23:55:22.721829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 23:55:22.721829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 23:55:22.721829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 23:55:22.721829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 23:55:22.721829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 23:55:22.721829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 23:55:22.721829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.721829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:22.721829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.721829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.721829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:22.721829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:22.721829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 23:55:22.721829 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 23:55:22.725235 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 23:55:22.725235 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.725235 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-39be6255-a178-4431-a6b0-0dbf83321bcb tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:55:22.725235 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-39be6255-a178-4431-a6b0-0dbf83321bcb tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013894 Aug 17 23:55:22.725235 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 679/1377] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Aug 17 23:55:22 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 23:55:22.733912 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f74d330c-c49d-48d4-8481-ffec73fca00d tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] Action: 'create', calling method: .version_select at 0x7f85fda6de50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1063277487", "metadata": {"Type": "work"}}} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f74d330c-c49d-48d4-8481-ffec73fca00d tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] Request method failure captured: Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 119 Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X_qoWiozLqGukes3jqj-6fDHwN66nIb4hBHX795_fwgIQzQx3262hbLRstjMlPDq2xsYmjp6Ug6EqSpdQ9CMc48dm4fibqGsYXkbOZgXJ82gfZUQCSxEIgzeEehx9occk6gWwwlnkcKPLadkuIGG77f-VpiJovJkw689SOWoQpXCBE Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: 3e9796a76d0846aebbad8db721bbca45 Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-VolumesNegativeTest-1722847964 Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:55:22.738450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:55:22.739819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3e9796a76d0846aebbad8db721bbca45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3e9796a76d0846aebbad8db721bbca45", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e9796a76d0846aebbad8db721bbca45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e9796a76d0846aebbad8db721bbca45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:55:22.739819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-VolumesNegativeTest-1722847964 Aug 17 23:55:22.739819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: 3e9796a76d0846aebbad8db721bbca45 Aug 17 23:55:22.739819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-VolumesNegativeTest-1722847964 Aug 17 23:55:22.739819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-VolumesNegativeTest-1722847964-project Aug 17 23:55:22.739819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:55:22.739819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:55:22.739819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 49de8489be8048a0b52167d12ab05f8b Aug 17 23:55:22.739819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-VolumesNegativeTest-1722847964-project Aug 17 23:55:22.739819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Aug 17 23:55:22.739819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1063277487", "metadata": {"Type": "work"}}} Aug 17 23:55:22.739819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: Aug 17 23:55:22.739819 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1063277487', 'metadata': {'Type': 'work'}}}} Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise error Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi '' Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:55:22.744771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:55:22.746434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 23:55:22.746434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 23:55:22.746434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:55:22.746434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:55:22.746434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 23:55:22.746434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 23:55:22.746434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 23:55:22.746434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 23:55:22.746434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 23:55:22.746434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 23:55:22.746434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 23:55:22.746434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.746434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:22.746434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.746434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.746434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:22.746434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:22.746434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 23:55:22.746434 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 23:55:22.748382 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 23:55:22.748382 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.748382 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-f74d330c-c49d-48d4-8481-ffec73fca00d tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:55:22.748382 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-f74d330c-c49d-48d4-8481-ffec73fca00d tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013415 Aug 17 23:55:22.748382 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 699/1378] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Aug 17 23:55:22 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 23:55:22.754534 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e195801c-2989-407a-8cea-a94bee1e510b tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] Calling method '.version_select at 0x7f85fe29f670>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:22.786176 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-e195801c-2989-407a-8cea-a94bee1e510b tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] HTTP exception thrown: Volume tempest-invalid-263465006 could not be found. Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e195801c-2989-407a-8cea-a94bee1e510b tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] Request method failure captured: Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-263465006 HTTP/1.1 Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X_qoWiozLqGukes3jqj-6fDHwN66nIb4hBHX795_fwgIQzQx3262hbLRstjMlPDq2xsYmjp6Ug6EqSpdQ9CMc48dm4fibqGsYXkbOZgXJ82gfZUQCSxEIgzeEehx9occk6gWwwlnkcKPLadkuIGG77f-VpiJovJkw689SOWoQpXCBE Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: 3e9796a76d0846aebbad8db721bbca45 Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-VolumesNegativeTest-1722847964 Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:55:22.788389 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:55:22.790448 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3e9796a76d0846aebbad8db721bbca45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3e9796a76d0846aebbad8db721bbca45", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e9796a76d0846aebbad8db721bbca45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e9796a76d0846aebbad8db721bbca45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:55:22.790448 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-VolumesNegativeTest-1722847964 Aug 17 23:55:22.790448 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: 3e9796a76d0846aebbad8db721bbca45 Aug 17 23:55:22.790448 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-VolumesNegativeTest-1722847964 Aug 17 23:55:22.790448 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-VolumesNegativeTest-1722847964-project Aug 17 23:55:22.790448 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:55:22.790448 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:55:22.790448 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 49de8489be8048a0b52167d12ab05f8b Aug 17 23:55:22.790448 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-VolumesNegativeTest-1722847964-project Aug 17 23:55:22.790448 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: Aug 17 23:55:22.790448 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Volume tempest-invalid-263465006 could not be found. Aug 17 23:55:22.790448 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': 'tempest-invalid-263465006'} Aug 17 23:55:22.790448 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:55:22.791359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.791359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 23:55:22.791359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 23:55:22.791359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 23:55:22.791359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 23:55:22.791359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 23:55:22.791359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 23:55:22.791359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 23:55:22.791359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 23:55:22.791359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 23:55:22.791359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 23:55:22.791359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 23:55:22.791359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 23:55:22.791359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 23:55:22.791359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 23:55:22.791359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-263465006 could not be found. (HTTP 404) (Request-ID: req-c38461e1-a570-4522-8e10-41f563100739) Aug 17 23:55:22.791359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.791359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:22.791359 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.792936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.792936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 23:55:22.792936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 23:55:22.792936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 23:55:22.792936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 23:55:22.792936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 23:55:22.792936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 23:55:22.792936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 23:55:22.792936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 23:55:22.792936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 23:55:22.792936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 23:55:22.792936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 23:55:22.792936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 23:55:22.792936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 23:55:22.792936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 23:55:22.792936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 23:55:22.792936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 23:55:22.792936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 23:55:22.792936 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 23:55:22.794124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 23:55:22.794124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 23:55:22.794124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 23:55:22.794124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 23:55:22.794124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-263465006 could not be found. Aug 17 23:55:22.794124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.794124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:22.794124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.794124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.794124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:22.794124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:22.794124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:55:22.794124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:55:22.794124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 23:55:22.794124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 23:55:22.794124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:55:22.794124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:55:22.794124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 23:55:22.794124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:55:22.794124 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-263465006 could not be found. Aug 17 23:55:22.795938 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.795938 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:22.795938 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.795938 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.795938 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:22.795938 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:22.795938 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:55:22.795938 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:55:22.795938 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-263465006 could not be found. Aug 17 23:55:22.795938 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.795938 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e195801c-2989-407a-8cea-a94bee1e510b tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] Returning 404 to user: Volume tempest-invalid-263465006 could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:55:22.795938 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e195801c-2989-407a-8cea-a94bee1e510b tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-263465006" status: 404 len: 98 microversion: 2.1 time: 0.039752 Aug 17 23:55:22.795938 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 680/1379] 10.222.0.26 () {58 vars in 1215 bytes} [Wed Aug 17 23:55:22 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-263465006 => generated 98 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 17 23:55:22.802475 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-8ea773ed-6528-4be6-9428-cf89311fc7d6 tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004266 Aug 17 23:55:22.802971 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 700/1380] 10.222.0.26 () {58 vars in 1140 bytes} [Wed Aug 17 23:55:22 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 17 23:55:22.812206 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-69ccf25c-5b3d-40b1-9535-4c6d0b11ec68 tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003877 Aug 17 23:55:22.812700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 681/1381] 10.222.0.26 () {58 vars in 1137 bytes} [Wed Aug 17 23:55:22 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 17 23:55:22.821657 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-15bfaa36-2467-496e-b687-4798ae3fd762 tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] Calling method '.version_select at 0x7f85fdd52670>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:22.849906 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-15bfaa36-2467-496e-b687-4798ae3fd762 tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] HTTP exception thrown: Volume 2339ad50-b360-475a-a5b6-cbd94b28a8c0 could not be found. Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-15bfaa36-2467-496e-b687-4798ae3fd762 tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] Request method failure captured: Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: DELETE /compute/v2.1/os-volumes/2339ad50-b360-475a-a5b6-cbd94b28a8c0 HTTP/1.1 Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X_qoWiozLqGukes3jqj-6fDHwN66nIb4hBHX795_fwgIQzQx3262hbLRstjMlPDq2xsYmjp6Ug6EqSpdQ9CMc48dm4fibqGsYXkbOZgXJ82gfZUQCSxEIgzeEehx9occk6gWwwlnkcKPLadkuIGG77f-VpiJovJkw689SOWoQpXCBE Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: 3e9796a76d0846aebbad8db721bbca45 Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-VolumesNegativeTest-1722847964 Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:55:22.852267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:55:22.854104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3e9796a76d0846aebbad8db721bbca45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3e9796a76d0846aebbad8db721bbca45", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e9796a76d0846aebbad8db721bbca45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e9796a76d0846aebbad8db721bbca45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:55:22.854104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-VolumesNegativeTest-1722847964 Aug 17 23:55:22.854104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: 3e9796a76d0846aebbad8db721bbca45 Aug 17 23:55:22.854104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-VolumesNegativeTest-1722847964 Aug 17 23:55:22.854104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-VolumesNegativeTest-1722847964-project Aug 17 23:55:22.854104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:55:22.854104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:55:22.854104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: 49de8489be8048a0b52167d12ab05f8b Aug 17 23:55:22.854104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-VolumesNegativeTest-1722847964-project Aug 17 23:55:22.854104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: Aug 17 23:55:22.854104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Volume 2339ad50-b360-475a-a5b6-cbd94b28a8c0 could not be found. Aug 17 23:55:22.854104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': '2339ad50-b360-475a-a5b6-cbd94b28a8c0'} Aug 17 23:55:22.854104 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:55:22.855147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.855147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 23:55:22.855147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 23:55:22.855147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 23:55:22.855147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 23:55:22.855147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 23:55:22.855147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 23:55:22.855147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 23:55:22.855147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 23:55:22.855147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 23:55:22.855147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 23:55:22.855147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 23:55:22.855147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 23:55:22.855147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 23:55:22.855147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 23:55:22.855147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2339ad50-b360-475a-a5b6-cbd94b28a8c0 could not be found. (HTTP 404) (Request-ID: req-803c3c77-5929-45c2-9bd9-34b88bea1b0c) Aug 17 23:55:22.855147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.855147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:22.855147 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.857324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.857324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 23:55:22.857324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 23:55:22.857324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 23:55:22.857324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 23:55:22.857324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 23:55:22.857324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 23:55:22.857324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 23:55:22.857324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 23:55:22.857324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 23:55:22.857324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 23:55:22.857324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 23:55:22.857324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 23:55:22.857324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 23:55:22.857324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 23:55:22.857324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 23:55:22.857324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 23:55:22.857324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 23:55:22.857324 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 23:55:22.858515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 23:55:22.858515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 23:55:22.858515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 23:55:22.858515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 23:55:22.858515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2339ad50-b360-475a-a5b6-cbd94b28a8c0 could not be found. Aug 17 23:55:22.858515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.858515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:22.858515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.858515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.858515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:22.858515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:22.858515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:55:22.858515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:55:22.858515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 23:55:22.858515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 23:55:22.858515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:55:22.858515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:55:22.858515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 23:55:22.858515 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:55:22.859702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2339ad50-b360-475a-a5b6-cbd94b28a8c0 could not be found. Aug 17 23:55:22.859702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.859702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:22.859702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.859702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.859702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:22.859702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:22.859702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:55:22.859702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:55:22.859702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2339ad50-b360-475a-a5b6-cbd94b28a8c0 could not be found. Aug 17 23:55:22.859702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.859702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-15bfaa36-2467-496e-b687-4798ae3fd762 tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] Returning 404 to user: Volume 2339ad50-b360-475a-a5b6-cbd94b28a8c0 could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:55:22.859702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-15bfaa36-2467-496e-b687-4798ae3fd762 tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/2339ad50-b360-475a-a5b6-cbd94b28a8c0" status: 404 len: 109 microversion: 2.1 time: 0.035903 Aug 17 23:55:22.859702 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 701/1382] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Aug 17 23:55:22 2022] DELETE /compute/v2.1/os-volumes/2339ad50-b360-475a-a5b6-cbd94b28a8c0 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:55:22.865028 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ba2c318f-701d-4f85-a733-7489e056a173 tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] Calling method '.version_select at 0x7f85fe3e7f70>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:55:22.893335 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-ba2c318f-701d-4f85-a733-7489e056a173 tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] HTTP exception thrown: Volume f830bf0a-7c34-424f-bbb3-7f1fd4448231 could not be found. Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ba2c318f-701d-4f85-a733-7489e056a173 tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] Request method failure captured: Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/os-volumes/f830bf0a-7c34-424f-bbb3-7f1fd4448231 HTTP/1.1 Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X_qoWiozLqGukes3jqj-6fDHwN66nIb4hBHX795_fwgIQzQx3262hbLRstjMlPDq2xsYmjp6Ug6EqSpdQ9CMc48dm4fibqGsYXkbOZgXJ82gfZUQCSxEIgzeEehx9occk6gWwwlnkcKPLadkuIGG77f-VpiJovJkw689SOWoQpXCBE Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: 3e9796a76d0846aebbad8db721bbca45 Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-VolumesNegativeTest-1722847964 Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:55:22.895327 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:55:22.896843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3e9796a76d0846aebbad8db721bbca45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3e9796a76d0846aebbad8db721bbca45", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e9796a76d0846aebbad8db721bbca45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e9796a76d0846aebbad8db721bbca45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:55:22.896843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-VolumesNegativeTest-1722847964 Aug 17 23:55:22.896843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: 3e9796a76d0846aebbad8db721bbca45 Aug 17 23:55:22.896843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-VolumesNegativeTest-1722847964 Aug 17 23:55:22.896843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-VolumesNegativeTest-1722847964-project Aug 17 23:55:22.896843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:55:22.896843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:55:22.896843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: 49de8489be8048a0b52167d12ab05f8b Aug 17 23:55:22.896843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-VolumesNegativeTest-1722847964-project Aug 17 23:55:22.896843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: Aug 17 23:55:22.896843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Volume f830bf0a-7c34-424f-bbb3-7f1fd4448231 could not be found. Aug 17 23:55:22.896843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': 'f830bf0a-7c34-424f-bbb3-7f1fd4448231'} Aug 17 23:55:22.896843 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:55:22.897868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.897868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 23:55:22.897868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 23:55:22.897868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 23:55:22.897868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 23:55:22.897868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 23:55:22.897868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 23:55:22.897868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 23:55:22.897868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 23:55:22.897868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 23:55:22.897868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 23:55:22.897868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 23:55:22.897868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 23:55:22.897868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 23:55:22.897868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 23:55:22.897868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f830bf0a-7c34-424f-bbb3-7f1fd4448231 could not be found. (HTTP 404) (Request-ID: req-ab99fb58-b3d7-4f55-a64d-9dceb21c5f66) Aug 17 23:55:22.897868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.897868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:22.897868 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.899102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.899102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 23:55:22.899102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 23:55:22.899102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 23:55:22.899102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 23:55:22.899102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 23:55:22.899102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 23:55:22.899102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 23:55:22.899102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 23:55:22.899102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 23:55:22.899102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 23:55:22.899102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 23:55:22.899102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 23:55:22.899102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 23:55:22.899102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 23:55:22.899102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 23:55:22.899102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 23:55:22.899102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 23:55:22.899102 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 23:55:22.901700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 23:55:22.901700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 23:55:22.901700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 23:55:22.901700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 23:55:22.901700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f830bf0a-7c34-424f-bbb3-7f1fd4448231 could not be found. Aug 17 23:55:22.901700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.901700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:22.901700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.901700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.901700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:22.901700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:22.901700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:55:22.901700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:55:22.901700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 23:55:22.901700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 23:55:22.901700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:55:22.901700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:55:22.901700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 23:55:22.901700 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:55:22.903251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f830bf0a-7c34-424f-bbb3-7f1fd4448231 could not be found. Aug 17 23:55:22.903251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.903251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:55:22.903251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.903251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:55:22.903251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:55:22.903251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:55:22.903251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:55:22.903251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:55:22.903251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f830bf0a-7c34-424f-bbb3-7f1fd4448231 could not be found. Aug 17 23:55:22.903251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:55:22.903251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-ba2c318f-701d-4f85-a733-7489e056a173 tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] Returning 404 to user: Volume f830bf0a-7c34-424f-bbb3-7f1fd4448231 could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:55:22.903251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-ba2c318f-701d-4f85-a733-7489e056a173 tempest-VolumesNegativeTest-1722847964 tempest-VolumesNegativeTest-1722847964-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f830bf0a-7c34-424f-bbb3-7f1fd4448231" status: 404 len: 109 microversion: 2.1 time: 0.036443 Aug 17 23:55:22.903251 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 682/1383] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Aug 17 23:55:22 2022] GET /compute/v2.1/os-volumes/f830bf0a-7c34-424f-bbb3-7f1fd4448231 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:56:49.097917 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 23:56:49.098683 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Wed Aug 17 23:56:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 23:56:52.649170 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_api:SELECT=25 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:56:52.650353 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG dbcounter [-] [131394] Writing DB stats nova_cell1:SELECT=35 {{(pid=131394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:56:52.651714 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:56:52.652961 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG dbcounter [-] [131395] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:56:52.655385 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-3f1bd0f5-25ef-40ab-8a63-68b81b5d24cf tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:56:52.656061 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-3f1bd0f5-25ef-40ab-8a63-68b81b5d24cf tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:56:52.665941 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3f1bd0f5-25ef-40ab-8a63-68b81b5d24cf tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:56:52.666768 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3f1bd0f5-25ef-40ab-8a63-68b81b5d24cf tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:56:52.667328 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3f1bd0f5-25ef-40ab-8a63-68b81b5d24cf tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:56:52.668079 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3f1bd0f5-25ef-40ab-8a63-68b81b5d24cf tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:56:52.668601 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3f1bd0f5-25ef-40ab-8a63-68b81b5d24cf tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:56:52.669357 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-3f1bd0f5-25ef-40ab-8a63-68b81b5d24cf tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:56:52.696801 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-3f1bd0f5-25ef-40ab-8a63-68b81b5d24cf tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Going to try to terminate instance {{(pid=131394) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:56:52.784174 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-3f1bd0f5-25ef-40ab-8a63-68b81b5d24cf tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 204 len: 0 microversion: 2.1 time: 0.136963 Aug 17 23:56:52.785303 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 702/1384] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:56:52 2022] DELETE /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 23:56:52.794895 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-1742da9f-2122-4723-9ae6-bf9527048d06 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:56:52.795602 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-1742da9f-2122-4723-9ae6-bf9527048d06 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:56:52.798219 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-fda57dfe-69f2-4db7-b860-3c70f0c1b410 req-e236eb40-0581-486e-b520-db3cc688c9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc", "tag": "2319edc7-eacd-41d6-8e52-fbb209f31acd"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:56:52.802347 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1742da9f-2122-4723-9ae6-bf9527048d06 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:56:52.802836 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1742da9f-2122-4723-9ae6-bf9527048d06 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:56:52.803267 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1742da9f-2122-4723-9ae6-bf9527048d06 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:56:52.804004 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1742da9f-2122-4723-9ae6-bf9527048d06 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:56:52.804448 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1742da9f-2122-4723-9ae6-bf9527048d06 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:56:52.804872 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-1742da9f-2122-4723-9ae6-bf9527048d06 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:56:52.807918 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-fda57dfe-69f2-4db7-b860-3c70f0c1b410 req-e236eb40-0581-486e-b520-db3cc688c9a0 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:56:52.808495 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-fda57dfe-69f2-4db7-b860-3c70f0c1b410 req-e236eb40-0581-486e-b520-db3cc688c9a0 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:56:52.809174 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-fda57dfe-69f2-4db7-b860-3c70f0c1b410 req-e236eb40-0581-486e-b520-db3cc688c9a0 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:56:52.821510 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-fda57dfe-69f2-4db7-b860-3c70f0c1b410 req-e236eb40-0581-486e-b520-db3cc688c9a0 service nova] Creating event network-changed:2319edc7-eacd-41d6-8e52-fbb209f31acd for instance 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc on hv-cinder-82002 Aug 17 23:56:52.826562 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-fda57dfe-69f2-4db7-b860-3c70f0c1b410 req-e236eb40-0581-486e-b520-db3cc688c9a0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177204 Aug 17 23:56:52.827386 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 683/1385] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:56:52.945499 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-1742da9f-2122-4723-9ae6-bf9527048d06 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:56:52.953378 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-1742da9f-2122-4723-9ae6-bf9527048d06 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1579 microversion: 2.1 time: 0.164135 Aug 17 23:56:52.953955 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 703/1386] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:56:52 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1579 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:56:53.975574 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a0cec1aa-6be7-4c39-ba05-db6ad0b1457a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:56:53.976337 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a0cec1aa-6be7-4c39-ba05-db6ad0b1457a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:56:53.982423 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a0cec1aa-6be7-4c39-ba05-db6ad0b1457a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:56:53.982910 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a0cec1aa-6be7-4c39-ba05-db6ad0b1457a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:56:53.983348 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a0cec1aa-6be7-4c39-ba05-db6ad0b1457a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:56:53.984059 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a0cec1aa-6be7-4c39-ba05-db6ad0b1457a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:56:53.984519 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a0cec1aa-6be7-4c39-ba05-db6ad0b1457a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:56:53.984943 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a0cec1aa-6be7-4c39-ba05-db6ad0b1457a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:56:54.201243 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a0cec1aa-6be7-4c39-ba05-db6ad0b1457a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:56:54.209287 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a0cec1aa-6be7-4c39-ba05-db6ad0b1457a tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1579 microversion: 2.1 time: 0.238371 Aug 17 23:56:54.209852 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 684/1387] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:56:53 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1579 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:56:55.230682 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-cedd182f-5124-4550-9b88-349316c5ad09 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:56:55.231900 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-cedd182f-5124-4550-9b88-349316c5ad09 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:56:55.239595 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cedd182f-5124-4550-9b88-349316c5ad09 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:56:55.240122 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cedd182f-5124-4550-9b88-349316c5ad09 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:56:55.240588 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cedd182f-5124-4550-9b88-349316c5ad09 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:56:55.241310 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cedd182f-5124-4550-9b88-349316c5ad09 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:56:55.241820 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cedd182f-5124-4550-9b88-349316c5ad09 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:56:55.242245 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-cedd182f-5124-4550-9b88-349316c5ad09 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:56:55.380298 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-cedd182f-5124-4550-9b88-349316c5ad09 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:56:55.388880 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-cedd182f-5124-4550-9b88-349316c5ad09 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1460 microversion: 2.1 time: 0.162246 Aug 17 23:56:55.389454 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 704/1388] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:56:55 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1460 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:56:55.434007 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-ef059ebe-a981-4dba-8bfc-48dee0d8a5ec req-c92e6ed6-aee3-4933-9b5f-0da68c777928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc", "name": "network-vif-deleted", "tag": "2319edc7-eacd-41d6-8e52-fbb209f31acd"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:56:55.445724 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-ef059ebe-a981-4dba-8bfc-48dee0d8a5ec req-c92e6ed6-aee3-4933-9b5f-0da68c777928 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:56:55.446203 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-ef059ebe-a981-4dba-8bfc-48dee0d8a5ec req-c92e6ed6-aee3-4933-9b5f-0da68c777928 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:56:55.446634 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-ef059ebe-a981-4dba-8bfc-48dee0d8a5ec req-c92e6ed6-aee3-4933-9b5f-0da68c777928 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:56:55.457778 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-ef059ebe-a981-4dba-8bfc-48dee0d8a5ec req-c92e6ed6-aee3-4933-9b5f-0da68c777928 service nova] Creating event network-vif-deleted:2319edc7-eacd-41d6-8e52-fbb209f31acd for instance 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc on hv-cinder-82002 Aug 17 23:56:55.462458 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-ef059ebe-a981-4dba-8bfc-48dee0d8a5ec req-c92e6ed6-aee3-4933-9b5f-0da68c777928 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032328 Aug 17 23:56:55.463031 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 685/1389] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:56:56.410010 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9f886215-6098-433b-a9f5-1a382a8766dc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:56:56.410701 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9f886215-6098-433b-a9f5-1a382a8766dc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:56:56.416678 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f886215-6098-433b-a9f5-1a382a8766dc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:56:56.417155 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f886215-6098-433b-a9f5-1a382a8766dc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:56:56.417589 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f886215-6098-433b-a9f5-1a382a8766dc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:56:56.418263 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f886215-6098-433b-a9f5-1a382a8766dc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:56:56.418719 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f886215-6098-433b-a9f5-1a382a8766dc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:56:56.419410 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9f886215-6098-433b-a9f5-1a382a8766dc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:56:56.479889 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-9f886215-6098-433b-a9f5-1a382a8766dc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:56:56.487721 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9f886215-6098-433b-a9f5-1a382a8766dc tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1392 microversion: 2.1 time: 0.081642 Aug 17 23:56:56.488318 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 705/1390] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:56:56 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1392 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:56:57.510033 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-3da0f9c4-c019-470f-b564-0054e05db3dd tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:56:57.510733 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-3da0f9c4-c019-470f-b564-0054e05db3dd tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:56:57.517313 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3da0f9c4-c019-470f-b564-0054e05db3dd tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:56:57.517785 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3da0f9c4-c019-470f-b564-0054e05db3dd tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:56:57.518215 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3da0f9c4-c019-470f-b564-0054e05db3dd tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:56:57.518897 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3da0f9c4-c019-470f-b564-0054e05db3dd tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:56:57.519345 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3da0f9c4-c019-470f-b564-0054e05db3dd tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:56:57.519762 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-3da0f9c4-c019-470f-b564-0054e05db3dd tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:56:57.584747 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-3da0f9c4-c019-470f-b564-0054e05db3dd tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:56:57.592225 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-3da0f9c4-c019-470f-b564-0054e05db3dd tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1226 microversion: 2.1 time: 0.086843 Aug 17 23:56:57.592784 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 686/1391] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:56:57 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:56:58.614159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-bfd91a6d-996d-4d02-8c71-f87633b561f2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:56:58.614771 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-bfd91a6d-996d-4d02-8c71-f87633b561f2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:56:58.621122 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bfd91a6d-996d-4d02-8c71-f87633b561f2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:56:58.621601 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bfd91a6d-996d-4d02-8c71-f87633b561f2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:56:58.622037 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bfd91a6d-996d-4d02-8c71-f87633b561f2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:56:58.622718 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bfd91a6d-996d-4d02-8c71-f87633b561f2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:56:58.623172 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bfd91a6d-996d-4d02-8c71-f87633b561f2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:56:58.623589 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-bfd91a6d-996d-4d02-8c71-f87633b561f2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:56:58.684676 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-bfd91a6d-996d-4d02-8c71-f87633b561f2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:56:58.692116 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-bfd91a6d-996d-4d02-8c71-f87633b561f2 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1226 microversion: 2.1 time: 0.081875 Aug 17 23:56:58.692678 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 706/1392] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:56:58 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:56:59.712777 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-c47e1590-e068-474a-9785-4283ced83f32 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:56:59.713319 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-c47e1590-e068-474a-9785-4283ced83f32 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:56:59.719730 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c47e1590-e068-474a-9785-4283ced83f32 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:56:59.720238 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c47e1590-e068-474a-9785-4283ced83f32 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:56:59.720697 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c47e1590-e068-474a-9785-4283ced83f32 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:56:59.721361 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c47e1590-e068-474a-9785-4283ced83f32 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:56:59.721814 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c47e1590-e068-474a-9785-4283ced83f32 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:56:59.722234 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-c47e1590-e068-474a-9785-4283ced83f32 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:56:59.782094 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-c47e1590-e068-474a-9785-4283ced83f32 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:56:59.789385 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-c47e1590-e068-474a-9785-4283ced83f32 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1226 microversion: 2.1 time: 0.080543 Aug 17 23:56:59.789945 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 687/1393] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:56:59 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:57:00.810672 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-e05183b8-502c-473d-81b3-4ad68ac1f439 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:57:00.811288 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-e05183b8-502c-473d-81b3-4ad68ac1f439 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:57:00.817671 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e05183b8-502c-473d-81b3-4ad68ac1f439 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:00.818151 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e05183b8-502c-473d-81b3-4ad68ac1f439 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:00.818590 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e05183b8-502c-473d-81b3-4ad68ac1f439 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:00.819276 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e05183b8-502c-473d-81b3-4ad68ac1f439 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:00.819729 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e05183b8-502c-473d-81b3-4ad68ac1f439 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:00.820182 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-e05183b8-502c-473d-81b3-4ad68ac1f439 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:00.886618 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-e05183b8-502c-473d-81b3-4ad68ac1f439 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:57:00.894632 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-e05183b8-502c-473d-81b3-4ad68ac1f439 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1226 microversion: 2.1 time: 0.087891 Aug 17 23:57:00.895190 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 707/1394] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:57:00 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:57:01.915620 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-90a27206-d647-42aa-aba3-1dd08e3b8c24 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:57:01.916256 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-90a27206-d647-42aa-aba3-1dd08e3b8c24 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:57:01.923517 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90a27206-d647-42aa-aba3-1dd08e3b8c24 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:01.924016 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90a27206-d647-42aa-aba3-1dd08e3b8c24 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:01.924455 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90a27206-d647-42aa-aba3-1dd08e3b8c24 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:01.925141 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90a27206-d647-42aa-aba3-1dd08e3b8c24 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:01.925593 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90a27206-d647-42aa-aba3-1dd08e3b8c24 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:01.926011 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-90a27206-d647-42aa-aba3-1dd08e3b8c24 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:01.987236 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-90a27206-d647-42aa-aba3-1dd08e3b8c24 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:57:01.994714 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-90a27206-d647-42aa-aba3-1dd08e3b8c24 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 200 len: 1226 microversion: 2.1 time: 0.082971 Aug 17 23:57:01.995276 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 688/1395] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:57:01 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:57:03.015031 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9de6aa21-240d-418c-bcef-3602729b81e9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:57:03.015933 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-9de6aa21-240d-418c-bcef-3602729b81e9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:57:03.023052 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9de6aa21-240d-418c-bcef-3602729b81e9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:03.023732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9de6aa21-240d-418c-bcef-3602729b81e9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:03.024477 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9de6aa21-240d-418c-bcef-3602729b81e9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:03.025120 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9de6aa21-240d-418c-bcef-3602729b81e9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:03.025623 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9de6aa21-240d-418c-bcef-3602729b81e9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:03.026290 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-9de6aa21-240d-418c-bcef-3602729b81e9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:03.040375 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-9de6aa21-240d-418c-bcef-3602729b81e9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] HTTP exception thrown: Instance 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc could not be found. Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9de6aa21-240d-418c-bcef-3602729b81e9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Request method failure captured: Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc HTTP/1.1 Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X3JNTkBR_1fT2tMSpUeTq-DFYXuXK-7PKWdV4z9Bsts0hKYvjsvem6yw6YRaUqTDww7UqGc_MyO6lNGeWvvX9rgBgI55iCF52dr4WU7s-8UHluHWlrluJ7vRe26698gsiPg6-jdwjR2avi2BMiX8eKZh78xWYeDNUYZY7JROO3nEBo Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: 8e81ed7b06f84b2bab3369334cb1f90a Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-TestVolumeBootPattern-2116673975 Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:57:03.042045 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:57:03.043858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8e81ed7b06f84b2bab3369334cb1f90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8e81ed7b06f84b2bab3369334cb1f90a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e81ed7b06f84b2bab3369334cb1f90a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e81ed7b06f84b2bab3369334cb1f90a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:57:03.043858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-TestVolumeBootPattern-2116673975 Aug 17 23:57:03.043858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: 8e81ed7b06f84b2bab3369334cb1f90a Aug 17 23:57:03.043858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116673975 Aug 17 23:57:03.043858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-TestVolumeBootPattern-2116673975-project Aug 17 23:57:03.043858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:57:03.043858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:57:03.043858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: cf6e346e96144628ac25c428be38870a Aug 17 23:57:03.043858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-TestVolumeBootPattern-2116673975-project Aug 17 23:57:03.043858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:57:03.043858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc could not be found. Aug 17 23:57:03.043858 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': '0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc'} Aug 17 23:57:03.045187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:57:03.045187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:57:03.045187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:57:03.045187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:57:03.045187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:57:03.045187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:57:03.045187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:57:03.045187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:57:03.045187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:57:03.045187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:57:03.045187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc could not be found. Aug 17 23:57:03.045187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:57:03.045187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:57:03.045187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:57:03.045187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:57:03.045187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:57:03.045187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:57:03.045187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:57:03.045187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:57:03.045187 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:57:03.047548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:57:03.047548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:57:03.047548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:57:03.047548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:57:03.047548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:57:03.047548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:57:03.047548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:57:03.047548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc could not be found. Aug 17 23:57:03.047548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:57:03.047548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:57:03.047548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:57:03.047548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:57:03.047548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:57:03.047548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:57:03.047548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:57:03.047548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:57:03.047548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc could not be found. Aug 17 23:57:03.047548 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:57:03.050597 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-9de6aa21-240d-418c-bcef-3602729b81e9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Returning 404 to user: Instance 0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:57:03.050597 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-9de6aa21-240d-418c-bcef-3602729b81e9 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc" status: 404 len: 111 microversion: 2.1 time: 0.032339 Aug 17 23:57:03.050597 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 708/1396] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:57:03 2022] GET /compute/v2.1/servers/0ce779e0-b141-4fb8-a3a0-f8f76ff1eefc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:57:07.185252 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-86f45de8-ccb9-454a-ad85-7daf5f4ef119 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:57:07.185802 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-86f45de8-ccb9-454a-ad85-7daf5f4ef119 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:57:07.187626 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [req-74ca0a4d-9009-49df-8b8a-68b61d686fbb req-04fa3916-413f-41af-83ea-7ff77f9f4402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "585c4cdc-136f-447b-a24b-fa93a6f21f2e", "tag": "546077da-31e3-4097-ae87-2b6d7eb19979"}]} {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:57:07.193056 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-86f45de8-ccb9-454a-ad85-7daf5f4ef119 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:07.193618 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-86f45de8-ccb9-454a-ad85-7daf5f4ef119 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:07.194309 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-86f45de8-ccb9-454a-ad85-7daf5f4ef119 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:07.195016 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-86f45de8-ccb9-454a-ad85-7daf5f4ef119 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:07.195476 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-86f45de8-ccb9-454a-ad85-7daf5f4ef119 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:07.195933 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-86f45de8-ccb9-454a-ad85-7daf5f4ef119 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:07.197450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-74ca0a4d-9009-49df-8b8a-68b61d686fbb req-04fa3916-413f-41af-83ea-7ff77f9f4402 service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:07.197979 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-74ca0a4d-9009-49df-8b8a-68b61d686fbb req-04fa3916-413f-41af-83ea-7ff77f9f4402 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:07.198414 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [req-74ca0a4d-9009-49df-8b8a-68b61d686fbb req-04fa3916-413f-41af-83ea-7ff77f9f4402 service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:07.211841 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.compute.server_external_events [req-74ca0a4d-9009-49df-8b8a-68b61d686fbb req-04fa3916-413f-41af-83ea-7ff77f9f4402 service nova] Creating event network-changed:546077da-31e3-4097-ae87-2b6d7eb19979 for instance 585c4cdc-136f-447b-a24b-fa93a6f21f2e on hv-cinder-82002 Aug 17 23:57:07.218936 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [req-74ca0a4d-9009-49df-8b8a-68b61d686fbb req-04fa3916-413f-41af-83ea-7ff77f9f4402 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034270 Aug 17 23:57:07.219813 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 709/1397] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 23:57:07.222122 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-86f45de8-ccb9-454a-ad85-7daf5f4ef119 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Going to try to terminate instance {{(pid=131395) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 23:57:07.305654 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-86f45de8-ccb9-454a-ad85-7daf5f4ef119 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "DELETE /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 204 len: 0 microversion: 2.1 time: 0.124183 Aug 17 23:57:07.306238 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 689/1398] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:57:07 2022] DELETE /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 23:57:07.315078 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-adc84a6c-9fd7-41e4-8462-81c58b18bfe6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:57:07.315843 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-adc84a6c-9fd7-41e4-8462-81c58b18bfe6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:57:07.322321 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-adc84a6c-9fd7-41e4-8462-81c58b18bfe6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:07.322806 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-adc84a6c-9fd7-41e4-8462-81c58b18bfe6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:07.323242 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-adc84a6c-9fd7-41e4-8462-81c58b18bfe6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:07.323936 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-adc84a6c-9fd7-41e4-8462-81c58b18bfe6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:07.324430 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-adc84a6c-9fd7-41e4-8462-81c58b18bfe6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:07.324853 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-adc84a6c-9fd7-41e4-8462-81c58b18bfe6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:07.462301 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-adc84a6c-9fd7-41e4-8462-81c58b18bfe6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:57:07.470412 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-adc84a6c-9fd7-41e4-8462-81c58b18bfe6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1579 microversion: 2.1 time: 0.159623 Aug 17 23:57:07.470976 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 710/1399] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:57:07 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1579 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:57:08.491264 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-cf1c9990-724a-4347-bc05-8b57ff080fb7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:57:08.491987 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-cf1c9990-724a-4347-bc05-8b57ff080fb7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:57:08.498322 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cf1c9990-724a-4347-bc05-8b57ff080fb7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:08.498810 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cf1c9990-724a-4347-bc05-8b57ff080fb7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:08.499250 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cf1c9990-724a-4347-bc05-8b57ff080fb7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:08.499944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cf1c9990-724a-4347-bc05-8b57ff080fb7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:08.500422 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cf1c9990-724a-4347-bc05-8b57ff080fb7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:08.500848 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-cf1c9990-724a-4347-bc05-8b57ff080fb7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:08.631233 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-cf1c9990-724a-4347-bc05-8b57ff080fb7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:57:08.638692 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-cf1c9990-724a-4347-bc05-8b57ff080fb7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1460 microversion: 2.1 time: 0.151727 Aug 17 23:57:08.639259 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 690/1400] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:57:08 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1460 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:57:09.659684 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-51c68543-268b-4ab4-8ad7-dc6967b691a6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:57:09.660344 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-51c68543-268b-4ab4-8ad7-dc6967b691a6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:57:09.666781 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-51c68543-268b-4ab4-8ad7-dc6967b691a6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:09.667264 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-51c68543-268b-4ab4-8ad7-dc6967b691a6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:09.667701 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-51c68543-268b-4ab4-8ad7-dc6967b691a6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:09.668415 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-51c68543-268b-4ab4-8ad7-dc6967b691a6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:09.668873 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-51c68543-268b-4ab4-8ad7-dc6967b691a6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:09.669299 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-51c68543-268b-4ab4-8ad7-dc6967b691a6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:09.797159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-51c68543-268b-4ab4-8ad7-dc6967b691a6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:57:09.804566 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-51c68543-268b-4ab4-8ad7-dc6967b691a6 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1460 microversion: 2.1 time: 0.149203 Aug 17 23:57:09.805118 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 711/1401] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:57:09 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1460 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:57:10.825422 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-a314a365-ec90-4f82-bed1-c654193bb953 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:57:10.826039 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-a314a365-ec90-4f82-bed1-c654193bb953 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:57:10.832455 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a314a365-ec90-4f82-bed1-c654193bb953 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:10.832939 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a314a365-ec90-4f82-bed1-c654193bb953 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:10.833384 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a314a365-ec90-4f82-bed1-c654193bb953 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:10.834079 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a314a365-ec90-4f82-bed1-c654193bb953 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:10.834535 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a314a365-ec90-4f82-bed1-c654193bb953 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:10.834963 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-a314a365-ec90-4f82-bed1-c654193bb953 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:10.966407 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.policy [None req-a314a365-ec90-4f82-bed1-c654193bb953 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131395) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:57:10.974511 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-a314a365-ec90-4f82-bed1-c654193bb953 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1460 microversion: 2.1 time: 0.152970 Aug 17 23:57:10.975074 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 691/1402] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:57:10 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1460 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:57:11.996054 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-0f0d3817-3a75-488e-81f9-ff10772a557d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:57:11.996608 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-0f0d3817-3a75-488e-81f9-ff10772a557d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:57:12.003478 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0f0d3817-3a75-488e-81f9-ff10772a557d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:12.003953 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0f0d3817-3a75-488e-81f9-ff10772a557d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:12.004410 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0f0d3817-3a75-488e-81f9-ff10772a557d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:12.005097 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0f0d3817-3a75-488e-81f9-ff10772a557d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:12.005552 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0f0d3817-3a75-488e-81f9-ff10772a557d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:12.005971 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-0f0d3817-3a75-488e-81f9-ff10772a557d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:12.149648 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-0f0d3817-3a75-488e-81f9-ff10772a557d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:57:12.157404 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-0f0d3817-3a75-488e-81f9-ff10772a557d tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1460 microversion: 2.1 time: 0.165314 Aug 17 23:57:12.159998 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 712/1403] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:57:11 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1460 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 23:57:12.186810 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [req-97acf189-0391-4fc1-80d6-4eadb487b7ab req-de8eab51-d0e2-4c22-a1e1-c664e368ddde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "585c4cdc-136f-447b-a24b-fa93a6f21f2e", "name": "network-vif-deleted", "tag": "546077da-31e3-4097-ae87-2b6d7eb19979"}]} {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 23:57:12.197243 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-97acf189-0391-4fc1-80d6-4eadb487b7ab req-de8eab51-d0e2-4c22-a1e1-c664e368ddde service nova] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:12.197719 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-97acf189-0391-4fc1-80d6-4eadb487b7ab req-de8eab51-d0e2-4c22-a1e1-c664e368ddde service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:12.198150 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [req-97acf189-0391-4fc1-80d6-4eadb487b7ab req-de8eab51-d0e2-4c22-a1e1-c664e368ddde service nova] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:12.209052 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.compute.server_external_events [req-97acf189-0391-4fc1-80d6-4eadb487b7ab req-de8eab51-d0e2-4c22-a1e1-c664e368ddde service nova] Creating event network-vif-deleted:546077da-31e3-4097-ae87-2b6d7eb19979 for instance 585c4cdc-136f-447b-a24b-fa93a6f21f2e on hv-cinder-82002 Aug 17 23:57:12.218609 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [req-97acf189-0391-4fc1-80d6-4eadb487b7ab req-de8eab51-d0e2-4c22-a1e1-c664e368ddde service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035384 Aug 17 23:57:12.219185 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 692/1404] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Aug 17 23:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 23:57:13.178683 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-17436d6a-cc63-4cc6-b19c-3d0b19f6c5c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:57:13.179227 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-17436d6a-cc63-4cc6-b19c-3d0b19f6c5c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:57:13.185726 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-17436d6a-cc63-4cc6-b19c-3d0b19f6c5c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:13.186206 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-17436d6a-cc63-4cc6-b19c-3d0b19f6c5c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:13.186640 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-17436d6a-cc63-4cc6-b19c-3d0b19f6c5c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:13.187863 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-17436d6a-cc63-4cc6-b19c-3d0b19f6c5c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:13.188337 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-17436d6a-cc63-4cc6-b19c-3d0b19f6c5c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:13.188759 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-17436d6a-cc63-4cc6-b19c-3d0b19f6c5c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:13.218265 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-17436d6a-cc63-4cc6-b19c-3d0b19f6c5c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:13.218732 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-17436d6a-cc63-4cc6-b19c-3d0b19f6c5c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:13.219159 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-17436d6a-cc63-4cc6-b19c-3d0b19f6c5c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:13.219593 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.objects.instance [None req-17436d6a-cc63-4cc6-b19c-3d0b19f6c5c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lazy-loading 'fault' on Instance uuid 585c4cdc-136f-447b-a24b-fa93a6f21f2e {{(pid=131394) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 23:57:13.259035 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.policy [None req-17436d6a-cc63-4cc6-b19c-3d0b19f6c5c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6e346e96144628ac25c428be38870a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e81ed7b06f84b2bab3369334cb1f90a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131394) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 23:57:13.267094 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-17436d6a-cc63-4cc6-b19c-3d0b19f6c5c0 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 200 len: 1230 microversion: 2.1 time: 0.092317 Aug 17 23:57:13.267640 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 713/1405] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:57:13 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 1230 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 23:57:14.289211 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e7c119b2-c255-489a-a555-46f12ce04033 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:57:14.289917 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-e7c119b2-c255-489a-a555-46f12ce04033 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 585c4cdc-136f-447b-a24b-fa93a6f21f2e] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:57:14.296328 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e7c119b2-c255-489a-a555-46f12ce04033 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:14.296808 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e7c119b2-c255-489a-a555-46f12ce04033 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:14.297246 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e7c119b2-c255-489a-a555-46f12ce04033 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:14.297930 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e7c119b2-c255-489a-a555-46f12ce04033 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:14.298386 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e7c119b2-c255-489a-a555-46f12ce04033 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:14.298810 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-e7c119b2-c255-489a-a555-46f12ce04033 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:14.311787 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-e7c119b2-c255-489a-a555-46f12ce04033 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] HTTP exception thrown: Instance 585c4cdc-136f-447b-a24b-fa93a6f21f2e could not be found. Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e7c119b2-c255-489a-a555-46f12ce04033 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Request method failure captured: Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e HTTP/1.1 Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X3JNTkBR_1fT2tMSpUeTq-DFYXuXK-7PKWdV4z9Bsts0hKYvjsvem6yw6YRaUqTDww7UqGc_MyO6lNGeWvvX9rgBgI55iCF52dr4WU7s-8UHluHWlrluJ7vRe26698gsiPg6-jdwjR2avi2BMiX8eKZh78xWYeDNUYZY7JROO3nEBo Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: 8e81ed7b06f84b2bab3369334cb1f90a Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-TestVolumeBootPattern-2116673975 Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:57:14.313387 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:57:14.315173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8e81ed7b06f84b2bab3369334cb1f90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8e81ed7b06f84b2bab3369334cb1f90a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e81ed7b06f84b2bab3369334cb1f90a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e81ed7b06f84b2bab3369334cb1f90a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:57:14.315173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-TestVolumeBootPattern-2116673975 Aug 17 23:57:14.315173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: 8e81ed7b06f84b2bab3369334cb1f90a Aug 17 23:57:14.315173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116673975 Aug 17 23:57:14.315173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-TestVolumeBootPattern-2116673975-project Aug 17 23:57:14.315173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:57:14.315173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:57:14.315173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: cf6e346e96144628ac25c428be38870a Aug 17 23:57:14.315173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-TestVolumeBootPattern-2116673975-project Aug 17 23:57:14.315173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:57:14.315173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance 585c4cdc-136f-447b-a24b-fa93a6f21f2e could not be found. Aug 17 23:57:14.315173 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': '585c4cdc-136f-447b-a24b-fa93a6f21f2e'} Aug 17 23:57:14.316269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:57:14.316269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:57:14.316269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:57:14.316269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:57:14.316269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:57:14.316269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:57:14.316269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:57:14.316269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:57:14.316269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:57:14.316269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:57:14.316269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 585c4cdc-136f-447b-a24b-fa93a6f21f2e could not be found. Aug 17 23:57:14.316269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:57:14.316269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:57:14.316269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:57:14.316269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:57:14.316269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:57:14.316269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:57:14.316269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:57:14.316269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:57:14.316269 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:57:14.317944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:57:14.317944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:57:14.317944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:57:14.317944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:57:14.317944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:57:14.317944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:57:14.317944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:57:14.317944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 585c4cdc-136f-447b-a24b-fa93a6f21f2e could not be found. Aug 17 23:57:14.317944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:57:14.317944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:57:14.317944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:57:14.317944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:57:14.317944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:57:14.317944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:57:14.317944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:57:14.317944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:57:14.317944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 585c4cdc-136f-447b-a24b-fa93a6f21f2e could not be found. Aug 17 23:57:14.317944 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:57:14.319444 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-e7c119b2-c255-489a-a555-46f12ce04033 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Returning 404 to user: Instance 585c4cdc-136f-447b-a24b-fa93a6f21f2e could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:57:14.319444 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-e7c119b2-c255-489a-a555-46f12ce04033 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e" status: 404 len: 111 microversion: 2.1 time: 0.030294 Aug 17 23:57:14.319444 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 693/1406] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:57:14 2022] GET /compute/v2.1/servers/585c4cdc-136f-447b-a24b-fa93a6f21f2e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:57:14.762452 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b72d91a2-5e04-4f71-a6da-09933ac47c82 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:57:14.762959 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.compute.api [None req-b72d91a2-5e04-4f71-a6da-09933ac47c82 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131394) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:57:14.770014 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b72d91a2-5e04-4f71-a6da-09933ac47c82 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:14.770493 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b72d91a2-5e04-4f71-a6da-09933ac47c82 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:14.770930 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b72d91a2-5e04-4f71-a6da-09933ac47c82 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:14.771683 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b72d91a2-5e04-4f71-a6da-09933ac47c82 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:14.772172 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b72d91a2-5e04-4f71-a6da-09933ac47c82 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:14.772600 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG oslo_concurrency.lockutils [None req-b72d91a2-5e04-4f71-a6da-09933ac47c82 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131394) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:14.785445 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.wsgi [None req-b72d91a2-5e04-4f71-a6da-09933ac47c82 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] HTTP exception thrown: Instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c could not be found. Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b72d91a2-5e04-4f71-a6da-09933ac47c82 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Request method failure captured: Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: request: DELETE /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c HTTP/1.1 Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept: application/json Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Accept-Encoding: identity Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Connection: close Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Length: 0 Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Content-Type: application/json Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Host: 10.222.0.26 Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Openstack-System-Scope: None Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: User-Agent: python-urllib3/1.26.11 Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Auth-Token: gAAAAABi_X3JNTkBR_1fT2tMSpUeTq-DFYXuXK-7PKWdV4z9Bsts0hKYvjsvem6yw6YRaUqTDww7UqGc_MyO6lNGeWvvX9rgBgI55iCF52dr4WU7s-8UHluHWlrluJ7vRe26698gsiPg6-jdwjR2avi2BMiX8eKZh78xWYeDNUYZY7JROO3nEBo Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Id: None Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Domain-Name: None Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Identity-Status: Confirmed Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Is-Admin-Project: True Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Id: default Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Domain-Name: Default Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Id: 8e81ed7b06f84b2bab3369334cb1f90a Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Project-Name: tempest-TestVolumeBootPattern-2116673975 Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Role: member,reader Aug 17 23:57:14.787076 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Roles: member,reader Aug 17 23:57:14.788833 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8e81ed7b06f84b2bab3369334cb1f90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8e81ed7b06f84b2bab3369334cb1f90a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e81ed7b06f84b2bab3369334cb1f90a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e81ed7b06f84b2bab3369334cb1f90a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:57:14.788833 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant: tempest-TestVolumeBootPattern-2116673975 Aug 17 23:57:14.788833 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Id: 8e81ed7b06f84b2bab3369334cb1f90a Aug 17 23:57:14.788833 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116673975 Aug 17 23:57:14.788833 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User: tempest-TestVolumeBootPattern-2116673975-project Aug 17 23:57:14.788833 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Id: default Aug 17 23:57:14.788833 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Domain-Name: Default Aug 17 23:57:14.788833 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Id: cf6e346e96144628ac25c428be38870a Aug 17 23:57:14.788833 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: X-User-Name: tempest-TestVolumeBootPattern-2116673975-project Aug 17 23:57:14.788833 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: method: > Aug 17 23:57:14.788833 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: exception: Instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c could not be found. Aug 17 23:57:14.788833 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: action_args: {'id': '12c673bc-cdc2-486b-a556-c6ce9a3fdb6c'} Aug 17 23:57:14.789814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:57:14.789814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:57:14.789814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:57:14.789814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:57:14.789814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:57:14.789814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:57:14.789814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:57:14.789814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:57:14.789814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:57:14.789814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:57:14.789814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c could not be found. Aug 17 23:57:14.789814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:57:14.789814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:57:14.789814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:57:14.789814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:57:14.789814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:57:14.789814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:57:14.789814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:57:14.789814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:57:14.789814 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:57:14.791431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:57:14.791431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 23:57:14.791431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 23:57:14.791431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 23:57:14.791431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 23:57:14.791431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:57:14.791431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:57:14.791431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:57:14.791431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:57:14.791431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c could not be found. Aug 17 23:57:14.791431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:57:14.791431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:57:14.791431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:57:14.791431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:57:14.791431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:57:14.791431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:57:14.791431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:57:14.791431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:57:14.791431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c could not be found. Aug 17 23:57:14.791431 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: ERROR nova.api.openstack.wsgi Aug 17 23:57:14.793084 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-b72d91a2-5e04-4f71-a6da-09933ac47c82 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Returning 404 to user: Instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c could not be found. {{(pid=131394) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:57:14.793084 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-b72d91a2-5e04-4f71-a6da-09933ac47c82 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "DELETE /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 404 len: 111 microversion: 2.1 time: 0.029911 Aug 17 23:57:14.793084 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 714/1407] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Aug 17 23:57:14 2022] DELETE /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:57:14.797139 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-6c9ef81c-e5cd-47d9-8110-07ef31fb1db1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '>' {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:57:14.797752 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.compute.api [None req-6c9ef81c-e5cd-47d9-8110-07ef31fb1db1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] [instance: 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c] Fetching instance by UUID {{(pid=131395) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 23:57:14.803651 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6c9ef81c-e5cd-47d9-8110-07ef31fb1db1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:14.804175 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6c9ef81c-e5cd-47d9-8110-07ef31fb1db1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:14.804623 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6c9ef81c-e5cd-47d9-8110-07ef31fb1db1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:14.805311 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6c9ef81c-e5cd-47d9-8110-07ef31fb1db1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Acquiring lock "21568e4d-f90d-40c1-be8c-94bd510fd532" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 23:57:14.805767 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6c9ef81c-e5cd-47d9-8110-07ef31fb1db1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 23:57:14.806194 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG oslo_concurrency.lockutils [None req-6c9ef81c-e5cd-47d9-8110-07ef31fb1db1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Lock "21568e4d-f90d-40c1-be8c-94bd510fd532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 23:57:14.820070 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.wsgi [None req-6c9ef81c-e5cd-47d9-8110-07ef31fb1db1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] HTTP exception thrown: Instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c could not be found. Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-6c9ef81c-e5cd-47d9-8110-07ef31fb1db1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Request method failure captured: Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: request: GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c HTTP/1.1 Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept: application/json Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Accept-Encoding: identity Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Connection: close Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Length: 0 Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Content-Type: application/json Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Host: 10.222.0.26 Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Openstack-System-Scope: None Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: User-Agent: python-urllib3/1.26.11 Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Auth-Token: gAAAAABi_X3JNTkBR_1fT2tMSpUeTq-DFYXuXK-7PKWdV4z9Bsts0hKYvjsvem6yw6YRaUqTDww7UqGc_MyO6lNGeWvvX9rgBgI55iCF52dr4WU7s-8UHluHWlrluJ7vRe26698gsiPg6-jdwjR2avi2BMiX8eKZh78xWYeDNUYZY7JROO3nEBo Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Id: None Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Domain-Name: None Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Identity-Status: Confirmed Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Is-Admin-Project: True Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Id: default Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Domain-Name: Default Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Id: 8e81ed7b06f84b2bab3369334cb1f90a Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Project-Name: tempest-TestVolumeBootPattern-2116673975 Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Role: member,reader Aug 17 23:57:14.821577 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Roles: member,reader Aug 17 23:57:14.823285 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8e81ed7b06f84b2bab3369334cb1f90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8e81ed7b06f84b2bab3369334cb1f90a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e81ed7b06f84b2bab3369334cb1f90a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e81ed7b06f84b2bab3369334cb1f90a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Aug 17 23:57:14.823285 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant: tempest-TestVolumeBootPattern-2116673975 Aug 17 23:57:14.823285 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Id: 8e81ed7b06f84b2bab3369334cb1f90a Aug 17 23:57:14.823285 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116673975 Aug 17 23:57:14.823285 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User: tempest-TestVolumeBootPattern-2116673975-project Aug 17 23:57:14.823285 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Id: default Aug 17 23:57:14.823285 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Domain-Name: Default Aug 17 23:57:14.823285 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Id: cf6e346e96144628ac25c428be38870a Aug 17 23:57:14.823285 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: X-User-Name: tempest-TestVolumeBootPattern-2116673975-project Aug 17 23:57:14.823285 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: method: > Aug 17 23:57:14.823285 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: exception: Instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c could not be found. Aug 17 23:57:14.823285 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: action_args: {'id': '12c673bc-cdc2-486b-a556-c6ce9a3fdb6c'} Aug 17 23:57:14.824705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: {{(pid=131395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 23:57:14.824705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:57:14.824705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 23:57:14.824705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 23:57:14.824705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 23:57:14.824705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 23:57:14.824705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 23:57:14.824705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 23:57:14.824705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 23:57:14.824705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 23:57:14.824705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c could not be found. Aug 17 23:57:14.824705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:57:14.824705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:57:14.824705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:57:14.824705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:57:14.824705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:57:14.824705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:57:14.824705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 23:57:14.824705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 23:57:14.824705 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 23:57:14.826082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 23:57:14.826082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 23:57:14.826082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 23:57:14.826082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 23:57:14.826082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 23:57:14.826082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 23:57:14.826082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 23:57:14.826082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c could not be found. Aug 17 23:57:14.826082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:57:14.826082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 23:57:14.826082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:57:14.826082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 23:57:14.826082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 23:57:14.826082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 23:57:14.826082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 23:57:14.826082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 23:57:14.826082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c could not be found. Aug 17 23:57:14.826082 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: ERROR nova.api.openstack.wsgi Aug 17 23:57:14.827433 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: DEBUG nova.api.openstack.wsgi [None req-6c9ef81c-e5cd-47d9-8110-07ef31fb1db1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Returning 404 to user: Instance 12c673bc-cdc2-486b-a556-c6ce9a3fdb6c could not be found. {{(pid=131395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 23:57:14.827433 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO nova.api.openstack.requestlog [None req-6c9ef81c-e5cd-47d9-8110-07ef31fb1db1 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c" status: 404 len: 111 microversion: 2.1 time: 0.029833 Aug 17 23:57:14.827433 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: [pid: 131395|app: 0|req: 694/1408] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Aug 17 23:57:14 2022] GET /compute/v2.1/servers/12c673bc-cdc2-486b-a556-c6ce9a3fdb6c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 23:57:16.118559 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: DEBUG nova.api.openstack.wsgi [None req-dff30768-52cc-4320-9cec-9e73def086b7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] Calling method '.version_select at 0x7f85fd97a160>' {{(pid=131394) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 23:57:16.140897 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO nova.api.openstack.requestlog [None req-dff30768-52cc-4320-9cec-9e73def086b7 tempest-TestVolumeBootPattern-2116673975 tempest-TestVolumeBootPattern-2116673975-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1844905335" status: 202 len: 0 microversion: 2.1 time: 0.026096 Aug 17 23:57:16.152653 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: [pid: 131394|app: 0|req: 715/1409] 10.222.0.26 () {58 vars in 1263 bytes} [Wed Aug 17 23:57:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1844905335 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 23:58:33.972299 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 23:58:33.972975 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Wed Aug 17 23:58:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 23:59:12.860690 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 23:59:12.861284 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Wed Aug 17 23:59:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 00:00:03.286767 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 00:00:03.287273 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Thu Aug 18 00:00:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 00:00:09.106386 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 00:00:09.106918 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Thu Aug 18 00:00:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 00:00:41.589166 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 00:00:41.589794 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Thu Aug 18 00:00:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 00:01:53.981450 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 00:01:53.982052 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Thu Aug 18 00:01:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 00:02:19.514425 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 00:02:19.515057 dv-cinder-820027-20-iscsi devstack@n-api.service[131394]: Thu Aug 18 00:02:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 00:02:32.868562 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 00:02:32.869119 dv-cinder-820027-20-iscsi devstack@n-api.service[131395]: Thu Aug 18 00:02:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!